00000001:02000400:3.0F:1789607539.568459:0:2966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_hostid 00000001:02000400:3.0:1789607560.009167:0:3186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789607562.113052:0:3229:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 663 MB/s 00000001:01000000:3.0:1789607562.362904:0:3229:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 663 MB/s 00000001:01000000:2.0:1789607562.616772:0:3229:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4271 MB/s 00000020:02000000:3.0:1789607563.438280:0:3277:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g2c5a7bf 00000400:02000000:0.0F:1789607564.657896:0:3292:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.202.103@tcp [8/256/0/180] 00008000:02000000:3.0:1789607568.460091:0:3442:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1789607624.050665:0:5247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789607633.243917:0:5828:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789607633.243922:0:5828:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789607633.244056:0:5828:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f799e641 00000080:02000400:2.0:1789607633.244068:0:5828:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789607633.249842:0:5828:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789607633.249858:0:5828:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789607633.250007:0:5828:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b6377d95) 00000020:00000080:3.0:1789607633.250027:0:5828:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789607633.266156:0:5828:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789607633.266807:0:5828:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789607633.289060:0:5828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789607633.289101:0:5828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789607633.289124:0:5828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789607633.289176:0:5828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789607633.289199:0:5828:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789607633.289913:0:5828:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789607633.289923:0:5828:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789607633.289933:0:5828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d001385d00 00000020:01000004:3.0:1789607633.289940:0:5828:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789607633.289945:0:5828:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789607633.289949:0:5828:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f799e641 from MGS 00000020:01000004:3.0:1789607633.289954:0:5828:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789607633.289962:0:5828:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c05182c5) 00000020:00000080:3.0:1789607633.289971:0:5828:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789607633.290017:0:5828:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f799e641 from MGS, refs=2 00080000:01000000:3.0:1789607633.290022:0:5828:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789607633.290026:0:5828:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d001385d0e 00000100:00100000:3.0:1789607633.290116:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789607633.290344:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789607633.290351:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789607633.291084:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789607633.291093:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789607633.292407:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607633.293058:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789607633.293064:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789607633.293890:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789607633.293900:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789607633.294357:0:5828:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789607633.294364:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0F:1789607633.295185:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607633.295194:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607633.295196:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607633.295883:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607633.295885:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607633.295887:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607633.296507:0:5828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789607633.301363:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789607633.545900:0:5828:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2791 MB/s 00000001:01000000:0.0:1789607633.795521:0:5828:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5000 MB/s 00000001:01000000:1.0:1789607634.045525:0:5828:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 611 MB/s 00000001:01000000:2.0:1789607634.296241:0:5828:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 559 MB/s 00010000:00010000:1.0:1789607634.316061:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1789607634.316778:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1789607634.342650:0:5828:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1789607634.342677:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789607634.342680:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789607634.347384:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789607634.347483:0:5828:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789607634.347541:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789607634.347844:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789607634.347870:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789607634.348317:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607634.348549:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789607634.348554:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789607634.357749:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789607634.357767:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789607634.358290:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789607634.358297:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789607634.359109:0:5828:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789607634.359130:0:5828:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.103@tcp' 00000020:01000004:1.0:1789607634.359132:0:5828:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789607634.359181:0:5828:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.103@tcp (typ=mgc) 00000020:00000080:1.0:1789607634.359201:0:5828:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.103@tcp (00000000ceacb9e9) 00000020:00000080:1.0:1789607634.359217:0:5828:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789607634.359339:0:5828:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009153f184@MGC192.168.202.103@tcp: add connection 192.168.202.103@tcp at head 00010000:00010000:1.0:1789607634.359525:0:5828:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.103@tcp-0 is initialized 00000040:01000000:1.0:1789607634.359530:0:5828:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789607634.367115:0:5843:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1789607634.368523:0:5845:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789607634.371553:0:5828:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.103@tcp (uuid d7ee8c63-baa9-4366-97c9-8054ab743e80) 00000020:00000080:2.0:1789607634.371580:0:5828:0:(genops.c:1384:class_connect()) connect: client d7ee8c63-baa9-4366-97c9-8054ab743e80, cookie 0x33f091d001385d1c 00000100:00080000:2.0:1789607634.371592:0:5828:0:(import.c:545:import_select_connection()) MGC192.168.202.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607634.371603:0:5828:0:(import.c:666:import_select_connection()) MGC192.168.202.103@tcp: import 000000009153f184 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1789607634.371655:0:5828:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b8c44e3f x1876539541028992/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789607634.371683:0:5828:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d7ee8c63-baa9-4366-97c9-8054ab743e80->MGS 00000020:01000004:2.0:1789607634.371706:0:5828:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789607634.371710:0:5828:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789607634.371740:0:5828:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000cfc832f6) 00000020:00000080:2.0:1789607634.371753:0:5828:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789607634.372010:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b8c44e3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d7ee8c63-baa9-4366-97c9-8054ab743e80:3308:1876539541028992:0@lo:250: 00000100:00100000:0.0:1789607634.372087:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607634.372297:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541028992 00000100:00100000:3.0:1789607634.372305:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541028992 00000100:00100000:3.0:1789607634.372342:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607634.372349:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a29c716a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1876539541028992:12345-0@lo:250: 00010000:00080000:3.0:1789607634.372371:0:5839:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d7ee8c63-baa9-4366-97c9-8054ab743e80@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:3.0:1789607634.372393:0:5839:0:(genops.c:1384:class_connect()) connect: client d7ee8c63-baa9-4366-97c9-8054ab743e80, cookie 0x33f091d001385d2a 00000100:00080000:3.0:1789607634.372543:0:5839:0:(import.c:65:import_set_state_nolock()) 0000000083cdab84 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607634.372595:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a29c716a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:3308:x1876539541028992:12345-0@lo:250: Request processed in 245us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607634.372603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607634.372647:0:3308:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789607634.372655:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.103@tcp: connect to target with instance 0 00000100:00080000:3.0:1789607634.372661:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789607634.372666:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789607634.372669:0:3308:0:(import.c:65:import_set_state_nolock()) 000000009153f184 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789607634.372671:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789607634.372681:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789607634.372685:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b8c44e3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d7ee8c63-baa9-4366-97c9-8054ab743e80:3308:1876539541028992:0@lo:250: 00000100:00100000:0.0:1789607634.395018:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789607634.395249:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789607634.395255:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789607634.397218:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789607634.397231:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789607634.398593:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789607634.398605:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789607634.403182:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607634.403583:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789607634.403590:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789607634.407040:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789607634.407058:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789607634.488900:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607634.489171:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789607634.489178:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789607634.491196:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789607634.491216:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789607634.494762:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607634.495685:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789607634.495691:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789607634.496275:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789607634.496281:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789607634.498765:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607634.499039:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789607634.499047:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789607634.501536:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789607634.505666:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789607634.507803:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607634.508134:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789607634.508141:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789607634.508994:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789607634.509003:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789607634.567937:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607634.568160:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789607634.568167:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789607634.572213:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789607634.572232:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789607634.579213:0:5828:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789607634.579227:0:5828:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789607634.581111:0:5828:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789607634.581140:0:5828:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789607634.581146:0:5828:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789607634.581278:0:5828:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789607634.581319:0:5828:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.103@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789607634.581323:0:5828:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789607634.581325:0:5828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607634.581327:0:5828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607634.581329:0:5828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607634.581330:0:5828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607634.581332:0:5828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607634.581333:0:5828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607634.581334:0:5828:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607634.581335:0:5828:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607634.581336:0:5828:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607634.581337:0:5828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607634.581339:0:5828:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789607634.581341:0:5828:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789607634.581343:0:5828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607634.581344:0:5828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607634.581345:0:5828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607634.581347:0:5828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607634.581348:0:5828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607634.581349:0:5828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607634.581349:0:5828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607634.581350:0:5828:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607634.581351:0:5828:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607634.581352:0:5828:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607634.581357:0:5828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607634.581358:0:5828:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789607634.581400:0:5828:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789607634.581417:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e54b8ace pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029120:0@lo:253: 00000100:00100000:3.0:1789607634.581525:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607634.581579:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bc65f50f going to sleep for 11 seconds 00000100:00100000:0.0:1789607634.581649:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541029120 00000100:00100000:0.0:1789607634.581657:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541029120 00000100:00100000:0.0:1789607634.581714:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607634.581731:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000099a50c79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:5828:x1876539541029120:12345-0@lo:253: 20000000:01000000:0.0:1789607634.581778:0:5842:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789607634.581781:0:5842:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789607634.583193:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789607634.583271:0:5842:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789607634.583614:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607634.584995:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789607634.588720:0:5842:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789607634.588739:0:5842:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789607634.588746:0:5842:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789607634.588750:0:5842:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789607634.588768:0:5842:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789607634.589055:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607634.589263:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789607634.589276:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789607634.589328:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789607634.589411:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789607634.589487:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789607634.589581:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789607634.589591:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789607634.589637:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789607634.589646:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789607634.589676:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789607634.589683:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789607634.589714:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789607634.589774:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789607634.589801:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789607634.589806:0:5842:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789607634.589816:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607634.589999:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789607634.590008:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789607634.590048:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789607634.590080:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789607634.590125:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789607634.590138:0:5842:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789607634.590208:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789607634.590217:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789607634.590259:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789607634.590313:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789607634.590352:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789607634.590363:0:5842:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789607634.590471:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789607634.590481:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789607634.590530:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789607634.590565:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789607634.590738:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789607634.590784:0:5842:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789607634.590791:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789607634.594719:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789607634.597269:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789607634.597301:0:5842:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.103@tcp for mdt 20000000:01000000:2.0:1789607634.597303:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.103@tcp (null) (null) (null) 00000040:00080000:2.0:1789607634.597333:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789607634.597339:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789607634.597379:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789607634.597385:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.103@tcp (null) (null) 00000040:00080000:2.0:1789607634.597470:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789607634.597480:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789607634.597507:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789607634.597534:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789607634.597588:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789607634.597591:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789607634.597597:0:5842:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789607634.597604:0:5842:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789607634.599866:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789607634.600025:0:5842:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789607634.611294:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789607634.611350:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1789607634.611440:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1789607634.611460:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789607634.611463:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789607634.611467:0:5842:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789607634.611480:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789607634.611483:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789607634.611513:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789607634.611516:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789607634.612303:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1789607634.612649:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1789607634.612691:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1789607634.612768:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1789607634.612783:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789607634.612785:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789607634.613264:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789607634.614030:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789607634.614082:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789607634.614116:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1789607634.614129:0:5842:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789607634.614132:0:5842:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1789607634.614140:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789607634.614162:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000795c0a4d/0x33f091d001385d31 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.614178:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000795c0a4d/0x33f091d001385d31 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.614188:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000795c0a4d/0x33f091d001385d31 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.614206:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000795c0a4d/0x33f091d001385d31 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.614212:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000795c0a4d/0x33f091d001385d31 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.614218:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000795c0a4d/0x33f091d001385d31 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.614224:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000795c0a4d already unused, calling callback (00000000a1f00df2) 00010000:00010000:3.0:1789607634.614227:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000795c0a4d/0x33f091d001385d31 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.614234:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000795c0a4d/0x33f091d001385d31 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.614247:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000795c0a4d/0x33f091d001385d31 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.614253:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000795c0a4d/0x33f091d001385d31 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.614258:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000795c0a4d/0x33f091d001385d31 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789607634.614278:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789607634.955810:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000099a50c79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:5828:x1876539541029120:12345-0@lo:253: Request processed in 374080us (374277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607634.955827:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607634.957769:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e54b8ace pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029120:0@lo:253: 10000000:01000000:2.0:1789607634.957791:0:5828:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789607634.957794:0:5828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607634.957796:0:5828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789607634.957798:0:5828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607634.957799:0:5828:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789607634.957800:0:5828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607634.957801:0:5828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607634.957802:0:5828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607634.957803:0:5828:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789607634.957805:0:5828:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789607634.957806:0:5828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607634.957808:0:5828:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789607634.957832:0:5828:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f799e641 from lustre-MDT0000 10000000:01000000:2.0:1789607634.957861:0:5828:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789607634.957865:0:5828:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789607634.957869:0:5828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99a1c6588000 10000000:01000000:2.0:1789607634.957873:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789607634.957883:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99a1c6588000 from 1 10000000:01000000:2.0:1789607634.957886:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789607634.957940:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 0000000000f0eac0/0x33f091d001385d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607634.957951:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 0000000000f0eac0/0x33f091d001385d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607634.957969:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 0000000000f0eac0/0x33f091d001385d38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607634.957987:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029248:0@lo:101: 00000100:00100000:2.0:1789607634.958066:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607634.958134:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f35160ac going to sleep for 11 seconds 00000100:00100000:0.0:1789607634.958301:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541029248 00000100:00100000:0.0:1789607634.958309:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541029248 00000100:00100000:0.0:1789607634.958362:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607634.958370:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007eb70581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:5828:x1876539541029248:12345-0@lo:101: 00010000:00010000:0.0:1789607634.958383:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607634.958396:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009caee55b/0x33f091d001385d3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385d38 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607634.958418:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009caee55b/0x33f091d001385d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385d38 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607634.958465:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009caee55b/0x33f091d001385d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385d38 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607634.958474:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009caee55b, rc 0) 00000100:00100000:0.0:1789607634.958517:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007eb70581 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+6:5828:x1876539541029248:12345-0@lo:101: Request processed in 149us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607634.958524:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607634.958688:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029248:0@lo:101: 00010000:00010000:2.0:1789607634.958700:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 0000000000f0eac0/0x33f091d001385d38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385d3f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607634.958708:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 0000000000f0eac0/0x33f091d001385d38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385d3f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607634.958763:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029376:0@lo:501: 00000100:00100000:2.0:1789607634.958790:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607634.958819:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f35160ac going to sleep for 11 seconds 00000100:00100000:1.0:1789607634.958873:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541029376 00000100:00100000:1.0:1789607634.958878:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541029376 00000100:00100000:1.0:1789607634.958910:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607634.958916:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a3164dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+6:5828:x1876539541029376:12345-0@lo:501: 00000100:00100000:1.0:1789607634.959156:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a3164dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+6:5828:x1876539541029376:12345-0@lo:501: Request processed in 239us (365us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789607634.959163:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607634.959504:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029376:0@lo:501: 10000000:01000000:2.0:1789607634.959528:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789607634.959549:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 0000000000f0eac0/0x33f091d001385d38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385d3f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607634.959557:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 0000000000f0eac0/0x33f091d001385d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385d3f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607634.959572:0:5828:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99a1c98a7800 10000000:01000000:2.0:1789607634.959576:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789607634.959581:0:5828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99a1c98a7800 10000000:01000000:2.0:1789607634.959583:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789607634.959585:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99a1c98a7800 from 1 10000000:01000000:2.0:1789607634.959587:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789607634.959605:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 000000008d177076/0x33f091d001385d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607634.959611:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 000000008d177076/0x33f091d001385d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607634.959618:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 000000008d177076/0x33f091d001385d46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607634.959630:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029504:0@lo:101: 00000100:00100000:2.0:1789607634.959667:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607634.959688:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f35160ac going to sleep for 11 seconds 00000100:00100000:3.0:1789607634.959848:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541029504 00000100:00100000:3.0:1789607634.959860:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541029504 00000100:00100000:3.0:1789607634.959892:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789607634.959898:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003d6c3884 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+6:5828:x1876539541029504:12345-0@lo:101: 00010000:00010000:3.0:1789607634.959906:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607634.959916:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000795c0a4d/0x33f091d001385d4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385d46 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.959933:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000795c0a4d/0x33f091d001385d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385d46 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.959942:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000795c0a4d/0x33f091d001385d4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385d46 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607634.959949:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000795c0a4d, rc 0) 00000100:00100000:3.0:1789607634.959999:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003d6c3884 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+7:5828:x1876539541029504:12345-0@lo:101: Request processed in 101us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607634.960004:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607634.960416:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029504:0@lo:101: 00010000:00010000:2.0:1789607634.960454:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 000000008d177076/0x33f091d001385d46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607634.960462:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 000000008d177076/0x33f091d001385d46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607634.960474:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789607634.960477:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 000000008d177076/0x33f091d001385d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607634.960495:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 000000008d177076/0x33f091d001385d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607634.960502:0:5828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789607634.960505:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789607634.960510:0:5828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99a1c98a7800 10000000:01000000:2.0:1789607634.960512:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789607634.960515:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789607634.960517:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789607634.960531:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 00000000e4a16c98/0x33f091d001385d54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607634.960536:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 00000000e4a16c98/0x33f091d001385d54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607634.960543:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 00000000e4a16c98/0x33f091d001385d54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607634.960555:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029632:0@lo:101: 00000100:00100000:2.0:1789607634.960583:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607634.960613:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f35160ac going to sleep for 11 seconds 00000100:00100000:1.0:1789607634.960693:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541029632 00000100:00100000:1.0:1789607634.960699:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541029632 00000100:00100000:1.0:1789607634.960751:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607634.960758:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000052d0bf5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+7:5828:x1876539541029632:12345-0@lo:101: 00010000:00010000:1.0:1789607634.960765:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607634.960780:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003d4e4780/0x33f091d001385d5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385d54 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607634.960794:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003d4e4780/0x33f091d001385d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385d54 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607634.960801:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003d4e4780/0x33f091d001385d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385d54 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607634.960807:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003d4e4780, rc 0) 00000100:00100000:1.0:1789607634.960846:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000052d0bf5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+8:5828:x1876539541029632:12345-0@lo:101: Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607634.960851:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607634.960989:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029632:0@lo:101: 00010000:00010000:2.0:1789607634.960999:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 00000000e4a16c98/0x33f091d001385d54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385d5b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607634.961006:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 00000000e4a16c98/0x33f091d001385d54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385d5b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607634.961055:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029760:0@lo:501: 00000100:00100000:2.0:1789607634.961078:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607634.961099:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f35160ac going to sleep for 11 seconds 00000100:00100000:0.0:1789607634.961324:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541029760 00000100:00100000:0.0:1789607634.961330:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541029760 00000100:00100000:0.0:1789607634.961349:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607634.961354:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000603836b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+8:5828:x1876539541029760:12345-0@lo:501: 00000100:00100000:0.0:1789607634.961600:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000603836b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:5828:x1876539541029760:12345-0@lo:501: Request processed in 245us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607634.961607:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607634.961844:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029760:0@lo:501: 00000100:00100000:2.0:1789607634.961875:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029888:0@lo:503: 00000100:00100000:2.0:1789607634.961911:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607634.961944:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f35160ac going to sleep for 11 seconds 00000100:00100000:3.0:1789607634.962448:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541029888 00000100:00100000:3.0:1789607634.962454:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541029888 00000100:00100000:3.0:1789607634.962492:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789607634.962498:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002b93489c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:5828:x1876539541029888:12345-0@lo:503: 00000100:00100000:3.0:1789607634.962679:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002b93489c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:5828:x1876539541029888:12345-0@lo:503: Request processed in 178us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607634.962686:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607634.963380:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541029888:0@lo:503: 00000100:00100000:2.0:1789607634.966556:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:5870:1876539541030016:0@lo:502: 00000100:00100000:2.0:1789607634.966629:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607634.966839:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541030016 00000100:00100000:3.0:1789607634.966848:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541030016 00000100:00100000:3.0:1789607634.966898:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607634.966905:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098e09d7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:5870:x1876539541030016:12345-0@lo:502: 00000100:00100000:2.0:1789607634.967124:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c7cfb9f going to sleep for 11 seconds 00000100:00100000:3.0:1789607634.967324:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098e09d7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:5870:x1876539541030016:12345-0@lo:502: Request processed in 419us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607634.967338:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607634.967514:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:5870:1876539541030016:0@lo:502: 00000020:01000000:2.0:1789607634.967542:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607634.967553:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607634.967556:0:5870:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789607634.967561:0:5870:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789607634.967565:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607634.967578:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000002483ef80) 00000020:00000080:2.0:1789607634.967595:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789607634.967601:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789607634.967678:0:5870:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789607634.967686:0:5870:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d001385d69 00000020:00000080:2.0:1789607634.968228:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789607634.968241:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607634.968248:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607634.968263:0:5870:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789607634.968267:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607634.968273:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607634.968275:0:5870:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789607634.968279:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607634.968294:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000002209eb75) 00000020:00000080:2.0:1789607634.968316:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789607634.968321:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789607634.968324:0:5870:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789607634.968327:0:5870:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789607634.968336:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789607634.968491:0:5870:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f799e641 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789607634.968510:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000010dc19c8) 00000020:00000080:2.0:1789607634.968520:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789607634.968602:0:5870:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789607634.968610:0:5870:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33f091d001385d7e 00000020:00000080:2.0:1789607634.968738:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789607634.968745:0:5870:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789607634.968750:0:5870:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x33f091d001385d85 00080000:01000000:2.0:1789607634.968756:0:5870:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789607634.968760:0:5870:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d001385d8c 00080000:10000000:2.0:1789607634.969265:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789607634.969562:0:5870:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789607634.990312:0:5870:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789607635.110120:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789607635.110468:0:5870:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789607635.115322:0:5870:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789607635.115849:0:5870:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789607635.154213:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000c5c5d8a6) 00000020:00000080:2.0:1789607635.154247:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789607635.154342:0:5870:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789607635.154350:0:5870:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d001385d9a 00000020:00000080:2.0:1789607635.160304:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789607635.162894:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607635.230351:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607635.306986:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607635.341419:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:2.0:1789607635.349848:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1789607635.403339:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607635.462405:0:5870:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1789607635.513925:0:5870:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x33f091d001385da1 00000020:00000080:1.0:1789607635.514285:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789607635.514298:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607635.514305:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607635.514308:0:5870:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789607635.514311:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607635.514316:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607635.514317:0:5870:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789607635.514321:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789607635.514354:0:5870:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789607635.514368:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607635.514371:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607635.514378:0:5870:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789607635.514381:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607635.514384:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607635.514385:0:5870:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789607635.514388:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789607635.514390:0:5870:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789607635.514467:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a6f511a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:5870:1876539541030144:0@lo:502: 00000100:00100000:1.0:1789607635.514542:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607635.514604:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 000000006414d226 going to sleep for 11 seconds 00000100:00100000:0.0:1789607635.514829:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541030144 00000100:00100000:0.0:1789607635.514838:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541030144 00000100:00100000:0.0:1789607635.514887:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789607635.514895:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d3aba005 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:5870:x1876539541030144:12345-0@lo:502: 00000100:00100000:0.0:1789607635.515200:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d3aba005 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:5870:x1876539541030144:12345-0@lo:502: Request processed in 306us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607635.515213:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607635.515314:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a6f511a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:5870:1876539541030144:0@lo:502: 00000020:01000000:2.0:1789607635.515339:0:5870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607635.515344:0:5870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607635.515346:0:5870:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789607635.515350:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789607635.516802:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789607635.516835:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789607635.516865:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 00000000e4a16c98/0x33f091d001385d54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385d5b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.516881:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 00000000e4a16c98/0x33f091d001385d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385d5b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607635.516890:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a1c98a7800 from 1 10000000:01000000:3.0:1789607635.516893:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789607635.516931:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.516938:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.516949:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607635.516967:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e874bab pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541030272:0@lo:101: 00000100:00100000:3.0:1789607635.517025:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.517075:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c6a5dbe going to sleep for 11 seconds 00000100:00100000:0.0:1789607635.517913:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541030272 00000100:00100000:0.0:1789607635.517923:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541030272 00000100:00100000:0.0:1789607635.517974:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789607635.517982:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9f4afc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:5828:x1876539541030272:12345-0@lo:101: 00010000:00010000:0.0:1789607635.517996:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607635.518011:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005d23e311/0x33f091d001385daf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385da8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.518045:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d23e311/0x33f091d001385daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385da8 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.518058:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005d23e311/0x33f091d001385daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385da8 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.518067:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005d23e311, rc 0) 00000100:00100000:0.0:1789607635.518139:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9f4afc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+10:5828:x1876539541030272:12345-0@lo:101: Request processed in 157us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607635.518149:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789607635.521969:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e874bab pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541030272:0@lo:101: 00010000:00010000:3.0:1789607635.522000:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385daf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.522013:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385daf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607635.522564:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e874bab pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541030400:0@lo:256: 00000100:00100000:3.0:1789607635.522641:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.522788:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c6a5dbe going to sleep for 11 seconds 00000100:00100000:2.0:1789607635.526379:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541030400 00000100:00100000:2.0:1789607635.526406:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541030400 00000100:00100000:2.0:1789607635.526533:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607635.526544:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b0a930f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+10:5828:x1876539541030400:12345-0@lo:256: 20000000:01000000:2.0:1789607635.526580:0:5842:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789607635.526589:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789607635.526781:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b0a930f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+10:5828:x1876539541030400:12345-0@lo:256: Request processed in 238us (4138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607635.526790:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607635.528321:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e874bab pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541030400:0@lo:256: 10000000:01000000:3.0:1789607635.529159:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789607635.529249:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385daf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.529263:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385daf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607635.529272:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1c98a7800 from 1 10000000:01000000:3.0:1789607635.529275:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607635.529313:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.529321:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.529330:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607635.529349:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004e874bab pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541030528:0@lo:101: 00000100:00100000:3.0:1789607635.529414:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.529489:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c6a5dbe going to sleep for 11 seconds 00000100:00100000:0.0:1789607635.531090:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541030528 00000100:00100000:0.0:1789607635.531102:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541030528 00000100:00100000:0.0:1789607635.531167:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607635.531176:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008ea9ee44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+10:5828:x1876539541030528:12345-0@lo:101: 00010000:00010000:0.0:1789607635.531194:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607635.531211:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000095f2cd30/0x33f091d001385dbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385db6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.531236:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000095f2cd30/0x33f091d001385dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385db6 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.531261:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000095f2cd30/0x33f091d001385dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385db6 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.531270:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000095f2cd30, rc 0) 00000100:00100000:0.0:1789607635.531339:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008ea9ee44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:5828:x1876539541030528:12345-0@lo:101: Request processed in 164us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607635.531346:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789607635.531939:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004e874bab pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541030528:0@lo:101: 00010000:00010000:2.0:1789607635.531982:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385dbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607635.531996:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385dbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607635.532095:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541030656:0@lo:501: 00000100:00100000:2.0:1789607635.532162:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607635.532220:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b6d504aa going to sleep for 11 seconds 00000100:00100000:3.0:1789607635.532258:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541030656 00000100:00100000:3.0:1789607635.532268:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541030656 00000100:00100000:3.0:1789607635.532311:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607635.532317:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cca20f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:5828:x1876539541030656:12345-0@lo:501: 00000100:00100000:0.0:1789607635.533183:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cca20f73 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:5828:x1876539541030656:12345-0@lo:501: Request processed in 865us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607635.533194:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607635.533951:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541030656:0@lo:501: 00000100:00100000:2.0:1789607635.534028:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541030784:0@lo:503: 00000100:00100000:2.0:1789607635.534107:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607635.534141:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b6d504aa going to sleep for 11 seconds 00000100:00100000:0.0:1789607635.540132:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541030784 00000100:00100000:0.0:1789607635.540148:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541030784 00000100:00100000:0.0:1789607635.540214:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789607635.540224:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d2a5fe07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:5828:x1876539541030784:12345-0@lo:503: 00000040:00080000:0.0:1789607635.540294:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607635.540388:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d2a5fe07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:5828:x1876539541030784:12345-0@lo:503: Request processed in 165us (6280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607635.540398:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607635.540515:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541030784:0@lo:503: 00000040:00080000:1.0:1789607635.544483:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789607635.545696:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789607635.545745:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607635.545773:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385dbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607635.545790:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385dbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607635.545869:0:5828:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789607635.545873:0:5828:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99a1c98a7800 10000000:01000000:2.0:1789607635.545876:0:5828:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99a1c98a7800 10000000:01000000:2.0:1789607635.545881:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789607635.545889:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a1c98a7800 from 1 10000000:01000000:2.0:1789607635.545893:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789607635.545945:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 00000000f5aeabb4/0x33f091d001385dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607635.545954:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 00000000f5aeabb4/0x33f091d001385dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607635.545967:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 00000000f5aeabb4/0x33f091d001385dc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607635.545997:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541030912:0@lo:101: 00000100:00100000:3.0:1789607635.554077:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.554166:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cc04ddd going to sleep for 11 seconds 00000100:00100000:0.0:1789607635.554169:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541030912 00000100:00100000:0.0:1789607635.554189:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541030912 00000100:00100000:0.0:1789607635.554263:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607635.554272:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022549860 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:5828:x1876539541030912:12345-0@lo:101: 00010000:00010000:0.0:1789607635.554289:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607635.554309:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aeb0bef1/0x33f091d001385dcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385dc4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.554337:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aeb0bef1/0x33f091d001385dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385dc4 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.554361:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aeb0bef1/0x33f091d001385dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385dc4 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.554370:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aeb0bef1, rc 0) 00000100:00100000:0.0:1789607635.554479:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022549860 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5828:x1876539541030912:12345-0@lo:101: Request processed in 209us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607635.554486:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789607635.554723:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002edbb277 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541030912:0@lo:101: 00010000:00010000:3.0:1789607635.554752:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 00000000f5aeabb4/0x33f091d001385dc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.554765:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 00000000f5aeabb4/0x33f091d001385dc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607635.554882:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541031040:0@lo:501: 00000100:00100000:3.0:1789607635.554924:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.554954:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ce4d7e0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607635.554992:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541031040 00000100:00100000:0.0:1789607635.554999:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541031040 00000100:00100000:0.0:1789607635.555038:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607635.555044:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000011881c34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5828:x1876539541031040:12345-0@lo:501: 00000100:00100000:0.0:1789607635.555306:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000011881c34 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5828:x1876539541031040:12345-0@lo:501: Request processed in 262us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607635.555314:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789607635.556878:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541031040:0@lo:501: 00000100:00100000:3.0:1789607635.556955:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541031168:0@lo:503: 00000100:00100000:3.0:1789607635.557043:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.557098:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 000000005ce4d7e0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607635.557104:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541031168 00000100:00100000:2.0:1789607635.557120:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541031168 00000100:00100000:2.0:1789607635.557192:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789607635.557200:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000008cfc3f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5828:x1876539541031168:12345-0@lo:503: 00000100:00100000:2.0:1789607635.557623:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000008cfc3f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5828:x1876539541031168:12345-0@lo:503: Request processed in 424us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607635.557631:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789607635.559984:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541031168:0@lo:503: 00000100:00100000:3.0:1789607635.569981:0:5875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:5875:1876539541031296:0@lo:502: 00000100:00100000:3.0:1789607635.570064:0:5875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.570120:0:5875:0:(client.c:2716:ptlrpc_set_wait()) set 000000002e534856 going to sleep for 11 seconds 00000100:00100000:2.0:1789607635.570622:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541031296 00000100:00100000:2.0:1789607635.570649:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541031296 00000100:00100000:2.0:1789607635.570727:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789607635.570739:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003ca3d64b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5875:x1876539541031296:12345-0@lo:502: 00000100:00100000:2.0:1789607635.571154:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003ca3d64b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5875:x1876539541031296:12345-0@lo:502: Request processed in 416us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607635.571163:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789607635.571748:0:5875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:5875:1876539541031296:0@lo:502: 00000020:01000004:3.0:1789607635.571828:0:5875:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789607635.571897:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000068d05aa4) 00000020:00000080:3.0:1789607635.571920:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789607635.572010:0:5875:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f799e641 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789607635.572014:0:5875:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f799e641 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789607635.572017:0:5875:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f799e641 4 00010000:00080000:3.0:1789607635.572042:0:5875:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008dcbd0da@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:3.0:1789607635.574935:0:5875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789607635.575148:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789607635.575188:0:5875:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789607635.575204:0:5875:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x33f091d001385dd9 00000100:00080000:3.0:1789607635.575215:0:5875:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789607635.575226:0:5875:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008dcbd0da using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1789607635.575269:0:5875:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000047da7f1 x1876539541031424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607635.575320:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876539541031424:0@lo:38: 00000100:00100000:3.0:1789607635.575406:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.575524:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541031424 00000100:00100000:3.0:1789607635.575532:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541031424 00000100:00100000:3.0:1789607635.575578:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607635.575587:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002e4bf105 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876539541031424:12345-0@lo:38: 00000100:00100000:3.0:1789607635.575656:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002e4bf105 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876539541031424:12345-0@lo:38: Request processed in 69us (251us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789607635.575663:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607635.575704:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607635.575711:0:3308:0:(import.c:65:import_set_state_nolock()) 000000008dcbd0da lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607635.584937:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789607635.584945:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876539541031424:0@lo:38: 00000100:00080000:3.0:1789607635.584996:0:5875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789607635.589314:0:5875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000337655a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:5875:1876539541031552:0@lo:502: 00000100:00100000:0.0:1789607635.589403:0:5875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607635.589484:0:5875:0:(client.c:2716:ptlrpc_set_wait()) set 000000007484d449 going to sleep for 11 seconds 00000100:00100000:2.0:1789607635.589589:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541031552 00000100:00100000:2.0:1789607635.589598:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541031552 00000100:00100000:2.0:1789607635.589641:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607635.589650:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000077dac523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5875:x1876539541031552:12345-0@lo:502: 00000100:00100000:2.0:1789607635.589926:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000077dac523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5875:x1876539541031552:12345-0@lo:502: Request processed in 277us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607635.589935:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789607635.592993:0:5875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000337655a1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:5875:1876539541031552:0@lo:502: 00000040:00080000:0.0:1789607635.593042:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789607635.593120:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789607635.593138:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789607635.593156:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 00000000f5aeabb4/0x33f091d001385dc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607635.593167:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 00000000f5aeabb4/0x33f091d001385dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789607635.593230:0:5828:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789607635.593232:0:5828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789607635.593233:0:5828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607635.593234:0:5828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607635.593235:0:5828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607635.593237:0:5828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607635.593238:0:5828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789607635.593239:0:5828:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789607635.593240:0:5828:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607635.593242:0:5828:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607635.593243:0:5828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607635.593244:0:5828:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789607635.593247:0:5828:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789607635.593250:0:5828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789607635.593251:0:5828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789607635.593252:0:5828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607635.593254:0:5828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607635.593255:0:5828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607635.593256:0:5828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607635.593257:0:5828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789607635.593258:0:5828:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789607635.593259:0:5828:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607635.593259:0:5828:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607635.593260:0:5828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607635.593261:0:5828:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789607635.593285:0:5828:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789607635.593298:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000337655a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541031680:0@lo:253: 00000100:00100000:0.0:1789607635.593361:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607635.593395:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 000000007484d449 going to sleep for 11 seconds 00000100:00100000:2.0:1789607635.594896:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541031680 00000100:00100000:2.0:1789607635.594907:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541031680 00000100:00100000:2.0:1789607635.594959:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789607635.594968:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000069687e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5828:x1876539541031680:12345-0@lo:253: 20000000:01000000:2.0:1789607635.594998:0:5842:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789607635.595011:0:5842:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789607635.631276:0:5842:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789607635.631312:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789607635.631364:0:5863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789607635.631369:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789607635.631391:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607635.631415:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005d23e311/0x33f091d001385daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385da8 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607635.631451:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607635.631490:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005d23e311/0x33f091d001385daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385da8 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607635.631504:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005d23e311/0x33f091d001385daf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385da8 expref: 12 pid: 5839 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607635.631519:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efad74f6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1876539541031808:0@lo:104: 00000100:00100000:2.0:1789607635.631582:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607635.631629:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set 0000000034645e0d going to sleep for 11 seconds 00000100:00100000:3.0:1789607635.631968:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541031808 00000100:00100000:3.0:1789607635.631975:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541031808 00000100:00100000:3.0:1789607635.632020:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607635.632029:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000076c86f03 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:5863:x1876539541031808:12345-0@lo:104: 00010000:00010000:3.0:1789607635.632044:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385daf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632108:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607635.632114:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000076c86f03 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:5863:x1876539541031808:12345-0@lo:104: Request processed in 86us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607635.632121:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789607635.632144:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607635.632150:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385daf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632157:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f877990d already unused, calling callback (00000000ec812828) 10000000:00010000:3.0:1789607635.632160:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385daf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632169:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385daf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607635.632175:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385daf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607635.632181:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607635.632208:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385daf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632215:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607635.632239:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385daf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632246:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: 00000000f877990d/0x33f091d001385da8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385daf expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632262:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607635.632264:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607635.632265:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607635.632319:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541031936:0@lo:103: 00000100:00100000:3.0:1789607635.632346:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607635.632438:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541031936 00000100:00100000:3.0:1789607635.632443:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541031936 00010000:00010000:3.0:1789607635.632460:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005d23e311/0x33f091d001385daf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385da8 expref: 13 pid: 5839 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607635.632482:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607635.632488:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aa0e6f7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:3310:x1876539541031936:12345-0@lo:103: 00010000:00010000:3.0:1789607635.632498:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607635.632501:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005d23e311/0x33f091d001385daf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385da8 expref: 13 pid: 5839 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632511:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005d23e311/0x33f091d001385daf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385da8 expref: 13 pid: 5839 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632526:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632534:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789607635.632556:0:5832:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001187726s 00010000:00010000:3.0:1789607635.632560:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632567:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632574:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632580:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632586:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c52afb0b already unused, calling callback (00000000a1f00df2) 00010000:00010000:3.0:1789607635.632590:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632597:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632604:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632614:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607635.632642:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aa0e6f7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:3310:x1876539541031936:12345-0@lo:103: Request processed in 155us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607635.632648:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607635.632683:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541031936:0@lo:103: 00010000:00010000:3.0:1789607635.632724:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005d23e311/0x33f091d001385daf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385da8 expref: 12 pid: 5839 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607635.632742:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efad74f6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1876539541031808:0@lo:104: 00010000:00010000:3.0:1789607635.632755:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632762:0:5863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632768:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607635.632773:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c52afb0b/0x33f091d001385de0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607635.639004:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000069687e17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:5828:x1876539541031680:12345-0@lo:253: Request processed in 44029us (45634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607635.639020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789607635.639108:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000337655a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:5828:1876539541031680:0@lo:253: 10000000:01000000:0.0:1789607635.639125:0:5828:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789607635.639128:0:5828:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789607635.639130:0:5828:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789607635.639132:0:5828:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607635.639133:0:5828:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607635.639149:0:5828:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607635.639151:0:5828:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607635.639152:0:5828:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789607635.639154:0:5828:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789607635.639155:0:5828:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789607635.639156:0:5828:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789607635.639158:0:5828:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607635.639159:0:5828:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789607635.639174:0:5828:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789607635.645357:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607635.646266:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607635.646575:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607635.646836:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607635.647034:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607635.647207:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607635.647993:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607635.648303:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607635.648593:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607635.648852:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607635.649082:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607635.649266:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1789607635.695497:0:5828:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789607635.743810:0:5828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1789607635.744255:0:5882:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789607635.747255:0:5828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789607635.747462:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1789607635.747760:0:5881:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789607635.747765:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:0.0:1789607635.748135:0:5828:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789607635.748146:0:5828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789607635.748342:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607635.757118:0:5828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789607635.758496:0:5828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789607635.760511:0:5828:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789607635.762546:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789607635.764185:0:5828:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789607635.765619:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789607635.765775:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789607635.765917:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789607635.766091:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789607635.766233:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789607635.766386:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789607635.766566:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789607635.766738:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789607635.766896:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789607635.767045:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789607635.767183:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789607635.767345:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789607635.767550:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789607635.767699:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789607635.774611:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789607635.783134:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789607635.784445:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789607635.784629:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789607635.791087:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789607635.793980:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000040:00080000:3.0:1789607635.794082:0:5882:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:0.0:1789607635.794209:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789607635.795175:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789607635.795401:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789607635.795595:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789607635.796022:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789607635.796181:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789607635.796706:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789607635.797726:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789607635.798120:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789607635.798976:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789607635.799129:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789607635.799271:0:5828:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789607635.799483:0:5828:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1789607635.848486:0:5882:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789607635.848583:0:5882:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789607635.848588:0:5882:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1789607635.878251:0:5828:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789607635.878285:0:5828:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb85e81c7f988 00100000:10000000:1.0:1789607635.878292:0:5828:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789607635.879001:0:5828:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789607635.879017:0:5828:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789607635.879039:0:5828:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789607635.879064:0:5828:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789607636.366343:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607637.387596:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607638.414838:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607639.435851:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607640.461193:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789607640.722564:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789607640.722572:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789607640.722575:0:38:0:(import.c:65:import_set_state_nolock()) 000000008dcbd0da lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607640.722599:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000008dcbd0da using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1789607640.722618:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c81f54ad x1876539541032192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607640.722661:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c81f54ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876539541032192:0@lo:38: 00000100:00100000:0.0:1789607640.722794:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607640.723369:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607640.723378:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000337655a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541032064:0@lo:400: 00000100:00100000:2.0:1789607640.723447:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607640.723487:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541032064 00000100:00100000:2.0:1789607640.723504:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541032064 00000100:00100000:2.0:1789607640.723539:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789607640.723547:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004d61ea4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:3312:x1876539541032064:12345-0@lo:400: 00000100:00100000:2.0:1789607640.723597:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004d61ea4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:3312:x1876539541032064:12345-0@lo:400: Request processed in 51us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607640.723604:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789607640.723649:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000337655a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541032064:0@lo:400: 00000100:00100000:3.0:1789607640.724376:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541032192 00000100:00100000:3.0:1789607640.724385:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541032192 00000100:00100000:3.0:1789607640.724460:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607640.724466:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000d08bfb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1876539541032192:12345-0@lo:38: 00010000:00080000:3.0:1789607640.724491:0:5849:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:3.0:1789607640.724531:0:5849:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x33f091d001385de7 00000004:00100000:3.0:1789607640.724596:0:5849:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789607640.724720:0:5849:0:(import.c:65:import_set_state_nolock()) 00000000b3a308a0 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607640.724792:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000d08bfb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876539541032192:12345-0@lo:38: Request processed in 324us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607640.724799:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789607640.726459:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c81f54ad x1876539541032192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789607640.726483:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789607640.726491:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789607640.726640:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789607640.726644:0:3308:0:(import.c:65:import_set_state_nolock()) 000000008dcbd0da lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789607640.726651:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c81f54ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876539541032192:0@lo:38: 00000001:02000400:2.0:1789607640.760696:0:6124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1789607641.227530:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789607641.227538:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a1c98a7800 from 3 10000000:01000000:3.0:1789607641.227543:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789607641.227588:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 00000000696bb52f/0x33f091d001385dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607641.227613:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 00000000696bb52f/0x33f091d001385dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607641.227624:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 00000000696bb52f/0x33f091d001385dee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607641.227646:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541032320:0@lo:101: 00000100:00100000:3.0:1789607641.227745:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607641.227790:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df1c1867 going to sleep for 11 seconds 00000100:00100000:2.0:1789607641.228619:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541032320 00000100:00100000:2.0:1789607641.228630:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541032320 00000100:00100000:2.0:1789607641.228690:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789607641.228699:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000300111af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:5845:x1876539541032320:12345-0@lo:101: 00010000:00010000:2.0:1789607641.228714:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607641.228729:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005b43e05d/0x33f091d001385df5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385dee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607641.228752:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005b43e05d/0x33f091d001385df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385dee expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607641.228763:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005b43e05d/0x33f091d001385df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385dee expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607641.228771:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005b43e05d, rc 0) 00000100:00100000:2.0:1789607641.231928:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000300111af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5845:x1876539541032320:12345-0@lo:101: Request processed in 3222us (4175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607641.231942:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789607641.233089:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541032320:0@lo:101: 00010000:00010000:3.0:1789607641.233117:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 00000000696bb52f/0x33f091d001385dee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385df5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607641.233130:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 00000000696bb52f/0x33f091d001385dee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385df5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607641.233203:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541032448:0@lo:256: 00000100:00100000:3.0:1789607641.233256:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607641.233301:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df1c1867 going to sleep for 11 seconds 00000100:00100000:2.0:1789607641.233319:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541032448 00000100:00100000:2.0:1789607641.233327:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541032448 00000100:00100000:2.0:1789607641.233370:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789607641.233378:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a688999b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5845:x1876539541032448:12345-0@lo:256: 20000000:01000000:2.0:1789607641.233406:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789607641.233446:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789607641.233451:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789607641.233531:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a688999b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5845:x1876539541032448:12345-0@lo:256: Request processed in 154us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607641.233538:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789607641.233636:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000047da7f1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541032448:0@lo:256: 10000000:01000000:3.0:1789607641.233678:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789607641.233682:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: 00000000696bb52f/0x33f091d001385dee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385df5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607641.233688:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: 00000000696bb52f/0x33f091d001385dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385df5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607641.483803:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607642.509907:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607643.531586:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607644.563445:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607645.579747:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607645.835793:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cd4d2e61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541032576:0@lo:400: 00000100:00100000:1.0:1789607645.835876:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607645.836259:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541032576 00000100:00100000:3.0:1789607645.836263:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000852b19e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541032704:0@lo:400: 00000100:00100000:0.0:1789607645.836268:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541032576 00000100:00100000:3.0:1789607645.836297:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607645.836315:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789607645.836323:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ec4c6b20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:3312:x1876539541032576:12345-0@lo:400: 00000100:00100000:3.0:1789607645.836333:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541032704 00000100:00100000:3.0:1789607645.836336:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541032704 00000100:00100000:3.0:1789607645.836399:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607645.836414:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000047da7f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541032704:12345-0@lo:400: 00000100:00100000:3.0:1789607645.836556:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000047da7f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541032704:12345-0@lo:400: Request processed in 142us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607645.836564:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789607645.836603:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000852b19e3 x1876539541032704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607645.836628:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000852b19e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541032704:0@lo:400: 00000020:00000080:2.0:1789607645.838494:0:6326:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6379f910 20000000:00000080:2.0:1789607645.838514:0:6326:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a1f61a9800 uarg=0000000000000000 20000000:01000000:2.0:1789607645.838549:0:6326:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789607645.838557:0:6326:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789607645.838562:0:6326:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789607645.838831:0:6326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789607645.838844:0:6326:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000100:00100000:0.0:1789607645.840303:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ec4c6b20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:3312:x1876539541032576:12345-0@lo:400: Request processed in 3972us (4419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607645.840319:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607645.840579:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cd4d2e61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541032576:0@lo:400: 00000040:00080000:3.0:1789607645.853314:0:6326:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607645.853604:0:6326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789607645.853670:0:6326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789607645.853723:0:6326:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789607645.853742:0:6326:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789607645.853763:0:6326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607645.853784:0:6326:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000095f2cd30/0x33f091d001385dbd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385db6 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607645.853791:0:6326:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607645.853828:0:6326:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000095f2cd30/0x33f091d001385dbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385db6 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607645.853842:0:6326:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000095f2cd30/0x33f091d001385dbd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385db6 expref: 11 pid: 5841 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607645.853855:0:6326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b026f0f0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6326:1876539541032832:0@lo:104: 00000100:00100000:3.0:1789607645.853919:0:6326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607645.853991:0:6326:0:(client.c:2716:ptlrpc_set_wait()) set 0000000045cae692 going to sleep for 11 seconds 00000100:00100000:1.0:1789607645.854318:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541032832 00000100:00100000:1.0:1789607645.854327:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541032832 00000100:00100000:1.0:1789607645.854385:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607645.854394:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009eaa8206 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:6326:x1876539541032832:12345-0@lo:104: 00010000:00010000:1.0:1789607645.854406:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385dbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854551:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789607645.854556:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009eaa8206 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:6326:x1876539541032832:12345-0@lo:104: Request processed in 164us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607645.854563:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789607645.854584:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607645.854589:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385dbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854597:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000055d92b67 already unused, calling callback (00000000ec812828) 10000000:00010000:1.0:1789607645.854600:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385dbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854607:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385dbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607645.854613:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385dbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607645.854628:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789607645.854656:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385dbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854663:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607645.854689:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385dbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607645.854694:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004534aa2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541032960:0@lo:103: 00010000:00010000:1.0:1789607645.854695:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: 0000000055d92b67/0x33f091d001385db6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385dbd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854710:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607645.854712:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607645.854713:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607645.854725:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607645.854738:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541032960 00000100:00100000:1.0:1789607645.854742:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541032960 00010000:00010000:1.0:1789607645.854757:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000095f2cd30/0x33f091d001385dbd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385db6 expref: 12 pid: 5841 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607645.854785:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607645.854791:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000081b7af18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:3310:x1876539541032960:12345-0@lo:103: 00010000:00010000:1.0:1789607645.854801:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607645.854805:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000095f2cd30/0x33f091d001385dbd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385db6 expref: 12 pid: 5841 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854814:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000095f2cd30/0x33f091d001385dbd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385db6 expref: 12 pid: 5841 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854830:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854837:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854849:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854866:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854871:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854876:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854880:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e87dbc73 already unused, calling callback (00000000a1f00df2) 00010000:00010000:1.0:1789607645.854883:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854889:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854896:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607645.854905:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607645.854933:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000081b7af18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:3310:x1876539541032960:12345-0@lo:103: Request processed in 143us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607645.854940:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607645.854975:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004534aa2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541032960:0@lo:103: 00010000:00010000:0.0:1789607645.856468:0:6326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000095f2cd30/0x33f091d001385dbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385db6 expref: 11 pid: 5841 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607645.856489:0:6326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b026f0f0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6326:1876539541032832:0@lo:104: 00010000:00010000:0.0:1789607645.856510:0:6326:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607645.856520:0:6326:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607645.856525:0:6326:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607645.856530:0:6326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e87dbc73/0x33f091d001385dfc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6326 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607646.604189:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607647.627927:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789607648.526140:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789607648.526148:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1c98a7800 from 1 10000000:01000000:1.0:1789607648.526153:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789607648.526204:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: 0000000056bdc1a9/0x33f091d001385e03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607648.526231:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: 0000000056bdc1a9/0x33f091d001385e03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607648.526243:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: 0000000056bdc1a9/0x33f091d001385e03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607648.526267:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004534aa2a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541033088:0@lo:101: 00000100:00100000:1.0:1789607648.526341:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607648.526443:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c7cfb9f going to sleep for 11 seconds 00000100:00100000:0.0:1789607648.526549:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541033088 00000100:00100000:0.0:1789607648.526566:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541033088 00000100:00100000:0.0:1789607648.526639:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789607648.526648:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cda9a1a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:5845:x1876539541033088:12345-0@lo:101: 00010000:00010000:0.0:1789607648.526660:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607648.526673:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa636189/0x33f091d001385e0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385e03 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607648.526703:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa636189/0x33f091d001385e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385e03 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607648.526712:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa636189/0x33f091d001385e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385e03 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607648.526721:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa636189, rc 0) 00000100:00100000:0.0:1789607648.526767:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cda9a1a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5845:x1876539541033088:12345-0@lo:101: Request processed in 120us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607648.526773:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789607648.526820:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004534aa2a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541033088:0@lo:101: 00010000:00010000:0.0:1789607648.526833:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: 0000000056bdc1a9/0x33f091d001385e03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607648.526842:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: 0000000056bdc1a9/0x33f091d001385e03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385e0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607648.526893:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000778af254 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541033216:0@lo:501: 00000100:00100000:0.0:1789607648.526918:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607648.526947:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 0000000014f26643 going to sleep for 11 seconds 00000100:00100000:2.0:1789607648.526961:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541033216 00000100:00100000:2.0:1789607648.526965:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541033216 00000100:00100000:2.0:1789607648.526996:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789607648.527017:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000318763fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5845:x1876539541033216:12345-0@lo:501: 00000100:00100000:2.0:1789607648.527400:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000318763fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5845:x1876539541033216:12345-0@lo:501: Request processed in 397us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607648.527407:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789607648.527655:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000778af254 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541033216:0@lo:501: 00000100:00100000:1.0:1789607648.527688:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006f2ee616 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541033344:0@lo:503: 00000100:00100000:1.0:1789607648.527726:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607648.527760:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f35160ac going to sleep for 11 seconds 00000100:00100000:2.0:1789607648.527900:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541033344 00000100:00100000:2.0:1789607648.527905:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541033344 00000100:00100000:2.0:1789607648.527936:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607648.527942:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ee5c2981 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5845:x1876539541033344:12345-0@lo:503: 00000100:00100000:2.0:1789607648.528231:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ee5c2981 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5845:x1876539541033344:12345-0@lo:503: Request processed in 288us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607648.528238:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789607648.528400:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006f2ee616 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541033344:0@lo:503: 00000100:00100000:2.0:1789607648.529309:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec4fbf76 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:6474:1876539541033472:0@lo:502: 00000100:00100000:2.0:1789607648.529357:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607648.529468:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ee2462cf going to sleep for 11 seconds 00000100:00100000:0.0:1789607648.531990:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541033472 00000100:00100000:0.0:1789607648.532985:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541033472 00000100:00100000:0.0:1789607648.533277:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789607648.533286:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000933f83e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6474:x1876539541033472:12345-0@lo:502: 00000100:00100000:0.0:1789607648.533658:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000933f83e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6474:x1876539541033472:12345-0@lo:502: Request processed in 373us (4300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607648.533667:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789607648.534776:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec4fbf76 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:6474:1876539541033472:0@lo:502: 00000020:01000000:1.0:1789607648.534814:0:6474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607648.534824:0:6474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607648.534826:0:6474:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789607648.534835:0:6474:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a1c98a7800 00000020:00000080:1.0:1789607648.534838:0:6474:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789607648.534958:0:6474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:6474:1876539541033600:0@lo:502: 00000100:00100000:1.0:1789607648.535192:0:6474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607648.535249:0:6474:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e02480 going to sleep for 11 seconds 00000100:00100000:0.0:1789607648.536225:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541033600 00000100:00100000:0.0:1789607648.536234:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541033600 00000100:00100000:0.0:1789607648.536285:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789607648.536293:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6474:x1876539541033600:12345-0@lo:502: 00000100:00100000:0.0:1789607648.536841:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6474:x1876539541033600:12345-0@lo:502: Request processed in 547us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607648.536850:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607648.536981:0:6474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:6474:1876539541033600:0@lo:502: 00000020:01000000:3.0:1789607648.537012:0:6474:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607648.537020:0:6474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607648.537022:0:6474:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789607648.537028:0:6474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789607648.540242:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789607648.540279:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789607648.540290:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167d800/0x33f091d001385e03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607648.540304:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c167d800/0x33f091d001385e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607648.653543:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607649.675947:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607650.699608:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607650.955734:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541033856:0@lo:400: 00000100:00100000:1.0:1789607650.955805:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607650.955875:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607650.955889:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541033728:0@lo:400: 00000100:00100000:1.0:1789607650.955922:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607650.955962:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541033856 00000100:00100000:1.0:1789607650.955970:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541033856 00000100:00100000:1.0:1789607650.956029:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607650.956039:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541033856:12345-0@lo:400: 00000100:00100000:1.0:1789607650.956089:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541033856:12345-0@lo:400: Request processed in 52us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607650.956096:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607650.956119:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541033728 00000100:00100000:1.0:1789607650.956122:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541033728 00000100:00100000:1.0:1789607650.956146:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607650.956152:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:3312:x1876539541033728:12345-0@lo:400: 00000100:00100000:1.0:1789607650.956180:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:3312:x1876539541033728:12345-0@lo:400: Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607650.956186:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607650.956225:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541033728:0@lo:400: 00010000:00080000:1.0:1789607650.956238:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a1f61cbb80 x1876539541033856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607650.956249:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541033856:0@lo:400: 00010000:00010000:1.0:1789607651.731193:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789607651.955667:0:6690:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789607651.955672:0:6690:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789607651.955804:0:6690:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99a1c8d84800 00000020:01000004:1.0:1789607651.955821:0:6690:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789607651.955832:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789607651.955846:0:6690:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99a1c658cd40) 00000020:00000080:1.0:1789607651.955862:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789607651.971052:0:6690:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789607651.971206:0:6690:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789607651.988956:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789607651.993644:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789607651.993679:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789607651.993737:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789607651.993762:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789607651.994325:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789607651.994335:0:6690:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789607651.994350:0:6690:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x33f091d001385e18 00000020:01000004:2.0:1789607651.994358:0:6690:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789607651.994377:0:6690:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789607651.994381:0:6690:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789607651.994386:0:6690:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789607651.994391:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789607651.994402:0:6690:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99a1f61a4d40) 00000020:00000080:2.0:1789607651.994414:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789607651.995634:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607651.995795:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789607651.995801:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789607652.003693:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789607652.003707:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789607652.004110:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789607652.004116:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789607652.005586:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607652.005915:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789607652.005934:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789607652.007046:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789607652.007057:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789607652.034657:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607652.034974:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789607652.034981:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789607652.036925:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789607652.036939:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789607652.038016:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789607652.038029:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789607652.047750:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607652.048678:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789607652.048687:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789607652.056691:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789607652.056707:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789607652.096410:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789607652.096648:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789607652.096653:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789607652.098538:0:6690:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789607652.098549:0:6690:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789607652.098886:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789607652.098905:0:6690:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789607652.098910:0:6690:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789607652.117725:0:6690:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789607652.117756:0:6690:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.103@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789607652.117759:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789607652.117760:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789607652.117761:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607652.117762:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607652.117826:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607652.117832:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607652.117833:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607652.117834:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607652.117835:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607652.117837:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607652.117837:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789607652.117840:0:6690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789607652.117842:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607652.117843:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789607652.117843:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607652.117844:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607652.117845:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607652.117845:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607652.117846:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607652.117846:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607652.117847:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607652.117848:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607652.117848:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789607652.117875:0:6690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789607652.117890:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541033984:0@lo:253: 00000100:00100000:3.0:1789607652.117948:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.118041:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607652.118042:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541033984 00000100:00100000:1.0:1789607652.118051:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541033984 00000100:00100000:1.0:1789607652.118117:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607652.118127:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6690:x1876539541033984:12345-0@lo:253: 20000000:01000000:1.0:1789607652.118154:0:5842:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789607652.118157:0:5842:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1789607652.118161:0:5842:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1789607652.118164:0:5842:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1789607652.118965:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607652.119120:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789607652.119131:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1789607652.119157:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1789607652.119161:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1789607652.119186:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1789607652.119230:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1789607652.119416:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789607652.119471:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.103@tcp 20000000:01000000:1.0:1789607652.119474:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.103@tcp (null) (null) (null) 00000040:00080000:1.0:1789607652.119510:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789607652.119518:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789607652.119568:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789607652.119574:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.103@tcp (null) (null) 00000040:00080000:1.0:1789607652.119595:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789607652.119601:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789607652.119616:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789607652.119641:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1789607652.120222:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789607652.120243:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.103@tcp 20000000:01000000:1.0:1789607652.120247:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.103@tcp (null) (null) (null) 00000040:00080000:1.0:1789607652.120284:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789607652.120291:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789607652.120333:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789607652.120340:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.103@tcp (null) (null) 00000040:00080000:1.0:1789607652.120384:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789607652.120392:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789607652.120476:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1789607652.120509:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1789607652.120525:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789607652.120528:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789607652.120531:0:5842:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789607652.120545:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789607652.120547:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789607652.120594:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789607652.120597:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789607652.121265:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1789607652.121314:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1789607652.121361:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789607652.121694:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789607652.121717:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789607652.121748:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789607652.121757:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789607652.121759:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789607652.122217:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1789607652.122262:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1789607652.122311:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789607652.122695:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789607652.122733:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1789607652.122765:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1789607652.122787:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789607652.122788:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789607652.123154:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789607652.123288:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1789607652.123325:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1789607652.123378:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1789607652.123541:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1789607652.123544:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1789607652.123553:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789607652.123587:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.123605:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d103b800/0x33f091d001385d3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385d38 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.123625:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1c167c400/0x33f091d001385d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385d54 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.123632:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d103ae00/0x33f091d001385dcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385dc4 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.123639:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.123680:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d103ae00/0x33f091d001385dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385dc4 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.123694:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d103ae00/0x33f091d001385dcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385dc4 expref: 12 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607652.123707:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541034112:0@lo:104: 00000100:00100000:1.0:1789607652.123841:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607652.123940:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1c167c400/0x33f091d001385d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385d54 expref: 12 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.123949:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1c167c400/0x33f091d001385d5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385d54 expref: 12 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607652.123958:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541034240:0@lo:104: 00000100:00100000:1.0:1789607652.123981:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607652.124073:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d103b800/0x33f091d001385d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385d38 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.124082:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d103b800/0x33f091d001385d3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385d38 expref: 12 pid: 5841 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607652.124099:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541034368:0@lo:104: 00000100:00100000:1.0:1789607652.124123:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607652.124143:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541034112 00000100:00100000:2.0:1789607652.124150:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541034112 00000100:00100000:3.0:1789607652.124159:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541034240 00000100:00100000:3.0:1789607652.124162:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541034240 00000100:00100000:3.0:1789607652.124192:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607652.124201:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:5842:x1876539541034112:12345-0@lo:104: 00010000:00010000:3.0:1789607652.124214:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607652.124263:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e02180 going to sleep for 11 seconds 00010000:00010000:3.0:1789607652.124275:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607652.124280:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:5842:x1876539541034112:12345-0@lo:104: Request processed in 81us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.124285:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541034112:0@lo:104: 00000100:00100000:3.0:1789607652.124286:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607652.124302:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541034368 00000100:00100000:3.0:1789607652.124311:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541034368 00000100:00100000:2.0:1789607652.124319:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607652.124326:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:5842:x1876539541034240:12345-0@lo:104: 00010000:00010000:2.0:1789607652.124334:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385d5b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.124508:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789607652.124514:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:5842:x1876539541034240:12345-0@lo:104: Request processed in 188us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.124521:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607652.124536:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607652.124542:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:5842:x1876539541034368:12345-0@lo:104: 00010000:00010000:2.0:1789607652.124549:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7f800/0x33f091d001385d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385d3f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.124599:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789607652.124604:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:5842:x1876539541034368:12345-0@lo:104: Request processed in 63us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.124610:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607652.124677:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541034240:0@lo:104: 00000100:00100000:1.0:1789607652.124685:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541034368:0@lo:104: 00010000:00010000:1.0:1789607652.124709:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125299:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789607652.125305:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125310:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d8d7e400 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607652.125313:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385dc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125319:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607652.125324:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385dc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607652.125328:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607652.125361:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385dc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125368:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607652.125393:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385dc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125401:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385dc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385dcb expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125414:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607652.125417:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385d5b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125437:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d8d7fe00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607652.125447:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385d54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385d5b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125455:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385d5b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607652.125461:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385d54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385d5b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607652.125466:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607652.125482:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385d54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385d5b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607652.125485:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789607652.125488:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607652.125493:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385d54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385d5b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607652.125497:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541034496:0@lo:103: 00010000:00010000:3.0:1789607652.125499:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385d54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385d5b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125511:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607652.125514:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7f800/0x33f091d001385d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385d3f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125519:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d8d7f800 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607652.125521:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7f800/0x33f091d001385d38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385d3f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125527:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7f800/0x33f091d001385d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385d3f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607652.125540:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789607652.125544:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7f800/0x33f091d001385d38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385d3f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607652.125549:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607652.125576:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7f800/0x33f091d001385d38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385d3f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125581:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789607652.125587:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541034624:0@lo:103: 00010000:00010000:3.0:1789607652.125595:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7f800/0x33f091d001385d38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385d3f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.125601:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7f800/0x33f091d001385d38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385d3f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607652.125606:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607652.125616:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607652.125618:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607652.125619:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607652.125629:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541034752:0@lo:103: 00000100:00100000:2.0:1789607652.125637:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541034496 00000100:00100000:2.0:1789607652.125642:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541034496 00000100:00100000:3.0:1789607652.125652:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789607652.125663:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d103ae00/0x33f091d001385dcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385dc4 expref: 13 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607652.125678:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541034624 00000100:00100000:2.0:1789607652.125681:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541034624 00010000:00010000:2.0:1789607652.125692:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1c167c400/0x33f091d001385d5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385d54 expref: 14 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607652.125702:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541034752 00000100:00100000:2.0:1789607652.125704:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541034752 00010000:00010000:2.0:1789607652.125713:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d103b800/0x33f091d001385d3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385d38 expref: 15 pid: 5841 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607652.125723:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607652.125729:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:3310:x1876539541034496:12345-0@lo:103: 00010000:00010000:2.0:1789607652.125738:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607652.125743:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d103ae00/0x33f091d001385dcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385dc4 expref: 15 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.125762:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d103ae00/0x33f091d001385dcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385dc4 expref: 15 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.125785:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103ae00/0x33f091d001385dcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385dc4 expref: 15 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.125798:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607652.125838:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:3310:x1876539541034496:12345-0@lo:103: Request processed in 108us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.125844:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607652.125860:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607652.125866:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:3310:x1876539541034624:12345-0@lo:103: 00010000:00010000:2.0:1789607652.125874:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607652.125878:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1c167c400/0x33f091d001385d5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385d54 expref: 13 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.125886:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1c167c400/0x33f091d001385d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385d54 expref: 13 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.125894:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167c400/0x33f091d001385d5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385d54 expref: 13 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.125903:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607652.125923:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:3310:x1876539541034624:12345-0@lo:103: Request processed in 58us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.125929:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607652.125940:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607652.125946:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201655880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:3311:x1876539541034752:12345-0@lo:103: 00010000:00010000:2.0:1789607652.125960:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607652.125964:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d103b800/0x33f091d001385d3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385d38 expref: 11 pid: 5841 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.125973:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d103b800/0x33f091d001385d3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385d38 expref: 11 pid: 5841 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.125983:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103b800/0x33f091d001385d3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385d38 expref: 11 pid: 5841 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.125994:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.126003:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.126016:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.126023:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.126031:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.126037:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.126042:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c167d400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607652.126046:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.126064:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.126076:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.126086:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607652.126116:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201655880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+10:3311:x1876539541034752:12345-0@lo:103: Request processed in 170us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.126122:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607652.126151:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541034752:0@lo:103: 00000100:00100000:3.0:1789607652.126237:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541034624:0@lo:103: 00000100:00100000:3.0:1789607652.126246:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541034496:0@lo:103: 00010000:00010000:1.0:1789607652.126314:0:5842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.126323:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.126329:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167d400/0x33f091d001385e26 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789607652.126344:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1789607652.126692:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607652.190099:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:6690:x1876539541033984:12345-0@lo:253: Request processed in 71964us (72140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.190113:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789607652.190649:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541033984:0@lo:253: 10000000:01000000:0.0:1789607652.190664:0:6690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789607652.190668:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789607652.190669:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789607652.190684:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607652.190685:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789607652.190687:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607652.190688:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607652.190689:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607652.190690:0:6690:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789607652.190692:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607652.190693:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789607652.190716:0:6690:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99a1c8d84800 from lustre-OST0000 10000000:01000000:0.0:1789607652.190740:0:6690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789607652.190743:0:6690:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789607652.190749:0:6690:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99a1c6588000 local copy 10000000:01000000:0.0:1789607652.190754:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789607652.190792:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.190802:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.190812:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607652.190827:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541034880:0@lo:101: 00000100:00100000:0.0:1789607652.190865:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607652.190984:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e4fba9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607652.193596:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541034880 00000100:00100000:1.0:1789607652.193611:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541034880 00000100:00100000:1.0:1789607652.193672:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789607652.193682:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:6690:x1876539541034880:12345-0@lo:101: 00010000:00010000:1.0:1789607652.193709:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607652.193731:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c167d400/0x33f091d001385e34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385e2d expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.193778:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c167d400/0x33f091d001385e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385e2d expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.193790:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c167d400/0x33f091d001385e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385e2d expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607652.193800:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c167d400, rc 0) 00000100:00100000:1.0:1789607652.193885:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+10:6690:x1876539541034880:12345-0@lo:101: Request processed in 205us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.193891:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607652.194074:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541034880:0@lo:101: 00010000:00010000:3.0:1789607652.194091:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x33f091d001385e34 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.194101:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x33f091d001385e34 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.194242:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035008:0@lo:501: 00000100:00100000:3.0:1789607652.194280:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.194323:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607652.194401:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541035008 00000100:00100000:2.0:1789607652.194406:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541035008 00000100:00100000:2.0:1789607652.194464:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607652.194472:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+10:6690:x1876539541035008:12345-0@lo:501: 00000100:00100000:2.0:1789607652.194714:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+10:6690:x1876539541035008:12345-0@lo:501: Request processed in 242us (433us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789607652.194722:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789607652.194846:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035008:0@lo:501: 10000000:01000000:3.0:1789607652.194860:0:6690:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789607652.194886:0:6690:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789607652.194892:0:6690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x33f091d001385e34 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.194901:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x33f091d001385e34 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.194908:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x33f091d001385e34 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.194935:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789607652.194953:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99a1c8d84800 10000000:01000000:3.0:1789607652.194958:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789607652.194963:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99a1c6588000 10000000:01000000:3.0:1789607652.194965:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789607652.194969:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99a1c6588000 from 1 10000000:01000000:3.0:1789607652.194972:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789607652.194992:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1510400/0x33f091d001385e3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.195000:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c1510400/0x33f091d001385e3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.195020:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c1510400/0x33f091d001385e3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.195032:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035136:0@lo:101: 00000100:00100000:3.0:1789607652.195060:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.195079:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7f00 going to sleep for 11 seconds 00010000:00010000:2.0:1789607652.195134:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607652.195141:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x33f091d001385e34 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.195148:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103aa00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607652.195152:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x33f091d001385e34 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.195167:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x33f091d001385e34 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607652.195175:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x33f091d001385e34 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607652.195180:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789607652.195198:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x33f091d001385e34 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.195205:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607652.195232:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x33f091d001385e34 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.195239:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d103aa00/0x33f091d001385e2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x33f091d001385e34 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.195256:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607652.195258:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607652.195259:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607652.195267:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607652.195278:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541035264:0@lo:103: 00000100:00100000:2.0:1789607652.195306:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607652.195333:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541035264 00000100:00100000:2.0:1789607652.195338:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541035264 00000100:00100000:2.0:1789607652.195367:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607652.195375:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+10:3311:x1876539541035264:12345-0@lo:103: 00010000:00010000:2.0:1789607652.195385:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607652.195397:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167d400/0x33f091d001385e34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d001385e2d expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.195419:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607652.195485:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:3311:x1876539541035264:12345-0@lo:103: Request processed in 110us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.195491:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607652.195544:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541035264:0@lo:103: 00000100:00100000:2.0:1789607652.195573:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541035136 00000100:00100000:2.0:1789607652.195577:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541035136 00000100:00100000:2.0:1789607652.195593:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789607652.195599:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:6690:x1876539541035136:12345-0@lo:101: 00010000:00010000:2.0:1789607652.195607:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607652.195618:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d8d7fc00/0x33f091d001385e42 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385e3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.195635:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d8d7fc00/0x33f091d001385e42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385e3b expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.195644:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d8d7fc00/0x33f091d001385e42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385e3b expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607652.195651:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d8d7fc00, rc 0) 00000100:00100000:2.0:1789607652.195678:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+10:6690:x1876539541035136:12345-0@lo:101: Request processed in 79us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.195683:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789607652.195825:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035136:0@lo:101: 00010000:00010000:3.0:1789607652.195838:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c1510400/0x33f091d001385e3b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e42 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.195848:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c1510400/0x33f091d001385e3b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385e42 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607652.195862:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789607652.195881:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1510400/0x33f091d001385e3b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e42 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.195889:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c1510400/0x33f091d001385e3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e42 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607652.195897:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789607652.195901:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789607652.195906:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789607652.195908:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789607652.195923:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.195930:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.195943:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.195955:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035392:0@lo:101: 00000100:00100000:3.0:1789607652.195982:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.195994:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607652.196073:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541035392 00000100:00100000:0.0:1789607652.196078:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541035392 00000100:00100000:0.0:1789607652.196100:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789607652.196106:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+10:6690:x1876539541035392:12345-0@lo:101: 00010000:00010000:0.0:1789607652.196113:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607652.196122:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103ba00/0x33f091d001385e50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385e49 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.196145:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103ba00/0x33f091d001385e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385e49 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.196155:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103ba00/0x33f091d001385e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385e49 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.196162:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103ba00, rc 0) 00000100:00100000:0.0:1789607652.196200:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:6690:x1876539541035392:12345-0@lo:101: Request processed in 94us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607652.196206:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789607652.196275:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035392:0@lo:101: 00010000:00010000:3.0:1789607652.196286:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e50 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.196293:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385e50 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.196358:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035520:0@lo:501: 00000100:00100000:3.0:1789607652.196379:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.196405:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607652.196454:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541035520 00000100:00100000:0.0:1789607652.196458:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541035520 00000100:00100000:0.0:1789607652.196474:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789607652.196478:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:6690:x1876539541035520:12345-0@lo:501: 00000100:00100000:0.0:1789607652.196704:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:6690:x1876539541035520:12345-0@lo:501: Request processed in 224us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607652.196711:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607652.196860:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035520:0@lo:501: 00000100:00100000:3.0:1789607652.196887:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035648:0@lo:503: 00000100:00100000:3.0:1789607652.196923:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.196939:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607652.197026:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541035648 00000100:00100000:1.0:1789607652.197031:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541035648 00000100:00100000:1.0:1789607652.197052:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607652.197058:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:6690:x1876539541035648:12345-0@lo:503: 00000100:00100000:1.0:1789607652.197211:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:6690:x1876539541035648:12345-0@lo:503: Request processed in 152us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.197218:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789607652.197296:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035648:0@lo:503: 00000040:00080000:3.0:1789607652.197597:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607652.197673:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035776:0@lo:502: 00000100:00100000:3.0:1789607652.197711:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.197731:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607652.197880:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541035776 00000100:00100000:2.0:1789607652.197884:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541035776 00000100:00100000:2.0:1789607652.197907:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789607652.197914:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:6690:x1876539541035776:12345-0@lo:502: 00000100:00100000:2.0:1789607652.198073:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:6690:x1876539541035776:12345-0@lo:502: Request processed in 158us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.198079:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607652.199194:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035776:0@lo:502: 00000040:00080000:3.0:1789607652.199544:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789607652.199619:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789607652.199655:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789607652.199709:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789607652.199749:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789607652.199784:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789607652.199820:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035904:0@lo:502: 00000100:00100000:3.0:1789607652.199892:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.199931:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607652.200791:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541035904 00000100:00100000:2.0:1789607652.200800:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541035904 00000100:00100000:2.0:1789607652.200861:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789607652.200870:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:6690:x1876539541035904:12345-0@lo:502: 00000100:00100000:2.0:1789607652.201101:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:6690:x1876539541035904:12345-0@lo:502: Request processed in 231us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.201109:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607652.201645:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541035904:0@lo:502: 00000040:00080000:3.0:1789607652.201799:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789607652.201813:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789607652.202337:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789607652.202345:0:6709:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789607652.202353:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607652.202355:0:6709:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789607652.202360:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607652.202376:0:6709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99a1e4cdb380) 00000020:00000080:3.0:1789607652.202397:0:6709:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789607652.202402:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789607652.202862:0:6709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a1c8d84800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789607652.202872:0:6709:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789607652.202879:0:6709:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x33f091d001385e5e 00010000:00010000:2.0:1789607652.211792:0:6709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789607652.212251:0:6709:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789607652.214572:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789607652.214850:0:6709:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789607652.227269:0:6709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789607652.227828:0:6709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789607652.230610:0:6709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789607652.230625:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607652.230633:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607652.230635:0:6709:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789607652.230639:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607652.230643:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607652.230645:0:6709:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789607652.230649:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789607652.230651:0:6709:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789607652.230712:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607652.230724:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607652.230726:0:6709:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789607652.230729:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789607652.235616:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789607652.235655:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789607652.235680:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e50 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.235694:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e50 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607652.235702:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1c8d84800 from 1 10000000:01000000:3.0:1789607652.235714:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607652.235752:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.235762:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.235772:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.235795:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036032:0@lo:101: 00000100:00100000:3.0:1789607652.235860:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.235905:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607652.235932:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541036032 00000100:00100000:3.0:1789607652.235939:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541036032 00000100:00100000:3.0:1789607652.235978:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789607652.235986:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:6690:x1876539541036032:12345-0@lo:101: 00010000:00010000:3.0:1789607652.235999:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607652.236012:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c1511600/0x33f091d001385e6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385e65 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.236036:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c1511600/0x33f091d001385e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385e65 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.236047:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c1511600/0x33f091d001385e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385e65 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.236054:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1511600, rc 0) 00000100:00100000:3.0:1789607652.236092:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6690:x1876539541036032:12345-0@lo:101: Request processed in 106us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607652.236110:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789607652.236162:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036032:0@lo:101: 00010000:00010000:3.0:1789607652.236175:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.236183:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385e6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.236281:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036160:0@lo:501: 00000100:00100000:3.0:1789607652.236305:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.236318:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607652.236386:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541036160 00000100:00100000:2.0:1789607652.236391:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541036160 00000100:00100000:2.0:1789607652.236443:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789607652.236453:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6690:x1876539541036160:12345-0@lo:501: 00000100:00100000:2.0:1789607652.236829:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6690:x1876539541036160:12345-0@lo:501: Request processed in 377us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607652.236836:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789607652.237005:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036160:0@lo:501: 00000100:00100000:3.0:1789607652.237032:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036288:0@lo:503: 00000100:00100000:3.0:1789607652.237072:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.237101:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789607652.237189:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541036288 00000100:00100000:1.0:1789607652.237195:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541036288 00000100:00100000:1.0:1789607652.237218:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607652.237225:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6690:x1876539541036288:12345-0@lo:503: 00000100:00100000:1.0:1789607652.237751:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6690:x1876539541036288:12345-0@lo:503: Request processed in 524us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.237759:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607652.238617:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036288:0@lo:503: 00000040:00080000:3.0:1789607652.238929:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607652.238996:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036416:0@lo:502: 00000100:00100000:3.0:1789607652.239045:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.239124:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7480 going to sleep for 11 seconds 00000100:00100000:0.0:1789607652.240965:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541036416 00000100:00100000:0.0:1789607652.240975:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541036416 00000100:00100000:0.0:1789607652.241056:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789607652.241066:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6690:x1876539541036416:12345-0@lo:502: 00000100:00100000:0.0:1789607652.241356:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6690:x1876539541036416:12345-0@lo:502: Request processed in 291us (2311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607652.241816:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607652.241929:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036416:0@lo:502: 00000040:00080000:3.0:1789607652.242277:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789607652.242331:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789607652.242369:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036544:0@lo:502: 00000100:00100000:3.0:1789607652.242419:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.242909:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607652.242942:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541036544 00000100:00100000:2.0:1789607652.242950:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541036544 00000100:00100000:1.0:1789607652.243042:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789607652.243051:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6690:x1876539541036544:12345-0@lo:502: 00000100:00100000:1.0:1789607652.243286:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6690:x1876539541036544:12345-0@lo:502: Request processed in 236us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.243293:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607652.243680:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036544:0@lo:502: 00000040:00080000:3.0:1789607652.243792:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789607652.243806:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789607652.244243:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607652.244253:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607652.244256:0:6713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789607652.244275:0:6713:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a1c8d84800 00000020:00000080:0.0:1789607652.244277:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789607652.244301:0:6713:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607652.244304:0:6713:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607652.244305:0:6713:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789607652.244308:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789607652.244732:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789607652.244750:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607652.244769:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.244781:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607652.244819:0:6690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789607652.244822:0:6690:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99a1c8d84800 10000000:01000000:3.0:1789607652.244825:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99a1c8d84800 10000000:01000000:3.0:1789607652.244829:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789607652.244834:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a1c8d84800 from 1 10000000:01000000:3.0:1789607652.244837:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789607652.244872:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.244879:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.244888:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.244906:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036672:0@lo:101: 00000100:00100000:3.0:1789607652.244954:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.245059:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607652.245128:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541036672 00000100:00100000:0.0:1789607652.245134:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541036672 00000100:00100000:0.0:1789607652.245205:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789607652.245213:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6690:x1876539541036672:12345-0@lo:101: 00010000:00010000:0.0:1789607652.245225:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607652.245238:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103a200/0x33f091d001385e7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385e73 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.245259:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103a200/0x33f091d001385e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385e73 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.245269:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103a200/0x33f091d001385e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385e73 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607652.245277:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a200, rc 0) 00000100:00100000:0.0:1789607652.245356:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6690:x1876539541036672:12345-0@lo:101: Request processed in 142us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607652.245363:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789607652.245931:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036672:0@lo:101: 00010000:00010000:3.0:1789607652.245947:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e7a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.245956:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385e7a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.246046:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036800:0@lo:501: 00000100:00100000:3.0:1789607652.246076:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.246101:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607652.246158:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541036800 00000100:00100000:1.0:1789607652.246163:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541036800 00000100:00100000:1.0:1789607652.246226:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789607652.246234:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6690:x1876539541036800:12345-0@lo:501: 00000100:00100000:1.0:1789607652.246492:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6690:x1876539541036800:12345-0@lo:501: Request processed in 258us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.246631:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789607652.246786:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036800:0@lo:501: 00000100:00100000:3.0:1789607652.246816:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036928:0@lo:503: 00000100:00100000:3.0:1789607652.246856:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.246878:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607652.246933:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541036928 00000100:00100000:1.0:1789607652.246937:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541036928 00000100:00100000:1.0:1789607652.246964:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789607652.246970:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6690:x1876539541036928:12345-0@lo:503: 00000100:00100000:1.0:1789607652.247128:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6690:x1876539541036928:12345-0@lo:503: Request processed in 157us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.247135:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607652.247208:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541036928:0@lo:503: 00000040:00080000:3.0:1789607652.247648:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607652.247705:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541037056:0@lo:502: 00000100:00100000:3.0:1789607652.247741:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.247761:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607652.247827:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541037056 00000100:00100000:0.0:1789607652.247832:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541037056 00000100:00100000:0.0:1789607652.247854:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789607652.247861:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6690:x1876539541037056:12345-0@lo:502: 00000100:00100000:0.0:1789607652.248026:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6690:x1876539541037056:12345-0@lo:502: Request processed in 165us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607652.248042:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789607652.248112:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541037056:0@lo:502: 00000040:00080000:3.0:1789607652.248375:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789607652.248454:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789607652.248494:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789607652.248887:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789607652.248926:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789607652.248975:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789607652.249012:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789607652.249061:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789607652.249111:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789607652.249147:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789607652.249182:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789607652.249228:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789607652.249278:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789607652.249315:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789607652.249363:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789607652.249399:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789607652.249488:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789607652.249873:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789607652.249914:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789607652.249948:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789607652.250004:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789607652.250041:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789607652.250074:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789607652.250123:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789607652.250167:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789607652.250213:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789607652.250254:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789607652.250289:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789607652.250338:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541037184:0@lo:502: 00000100:00100000:3.0:1789607652.250411:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.250832:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607652.250960:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541037184 00000100:00100000:0.0:1789607652.250968:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541037184 00000100:00100000:0.0:1789607652.251054:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789607652.251064:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6690:x1876539541037184:12345-0@lo:502: 00000100:00100000:0.0:1789607652.251299:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6690:x1876539541037184:12345-0@lo:502: Request processed in 236us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607652.251306:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607652.251392:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541037184:0@lo:502: 00000040:00080000:3.0:1789607652.251536:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789607652.251551:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789607652.252332:0:6714:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789607652.252357:0:6714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99a1ff84b380) 00000020:00000080:3.0:1789607652.252377:0:6714:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789607652.252659:0:6714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a1c8d84800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789607652.252670:0:6714:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a1c8d84800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789607652.252673:0:6714:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a1c8d84800 3 00010000:00080000:3.0:1789607652.252711:0:6714:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a201cc1000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.103@tcp at head 00010000:00010000:3.0:1789607652.255760:0:6714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789607652.255967:0:6714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789607652.256004:0:6714:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789607652.256019:0:6714:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x33f091d001385e88 00000100:00080000:3.0:1789607652.256031:0:6714:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789607652.256043:0:6714:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99a201cc1000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1789607652.256080:0:6714:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a201654e00 x1876539541037312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607652.256110:0:6714:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789607652.256170:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541037440:0@lo:400: 00000100:00100000:3.0:1789607652.256234:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.256294:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541037440 00000100:00100000:3.0:1789607652.256300:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541037440 00000100:00100000:3.0:1789607652.256340:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607652.256348:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541037440:12345-0@lo:400: 00000100:00100000:3.0:1789607652.256397:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541037440:12345-0@lo:400: Request processed in 49us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607652.256405:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789607652.256474:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a201655f80 x1876539541037440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607652.256487:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541037440:0@lo:400: 00000100:00100000:2.0:1789607652.256750:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876539541037312:0@lo:38: 00000100:00100000:2.0:1789607652.256785:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607652.257671:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541037312 00000100:00100000:1.0:1789607652.257679:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541037312 00000100:00100000:1.0:1789607652.257717:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607652.257723:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1876539541037312:12345-0@lo:38: 00010000:00080000:1.0:1789607652.257748:0:5848:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:1.0:1789607652.257783:0:5848:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x33f091d001385e8f 00000004:00100000:1.0:1789607652.257798:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789607652.257831:0:5848:0:(import.c:65:import_set_state_nolock()) ffff99a1ff53b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607652.257887:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876539541037312:12345-0@lo:38: Request processed in 162us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.257902:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789607652.257942:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a201654e00 x1876539541037312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607652.257951:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789607652.257957:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789607652.257966:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789607652.257970:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789607652.257972:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a201cc1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789607652.257977:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876539541037312:0@lo:38: 00000040:00080000:1.0:1789607652.259047:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1789607652.259279:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789607652.259301:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789607652.259356:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e7a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.259378:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385e7a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789607652.259455:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789607652.259457:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789607652.259459:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607652.259460:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607652.259462:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607652.259463:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607652.259464:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607652.259466:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607652.259467:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607652.259469:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607652.259470:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607652.259474:0:6690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789607652.259476:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607652.259477:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789607652.259478:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607652.259479:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607652.259480:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607652.259481:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607652.259482:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607652.259483:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607652.259484:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607652.259485:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607652.259486:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607652.259514:0:6690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789607652.259530:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541037568:0@lo:253: 00000100:00100000:3.0:1789607652.259601:0:6690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.259629:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789607652.262212:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541037568 00000100:00100000:1.0:1789607652.262224:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541037568 00000100:00100000:1.0:1789607652.262284:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789607652.262294:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6690:x1876539541037568:12345-0@lo:253: 20000000:01000000:1.0:1789607652.262322:0:5841:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789607652.262337:0:5841:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789607652.288251:0:5841:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789607652.288265:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789607652.290115:0:5863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789607652.290123:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789607652.290147:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290185:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385df5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385dee expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290193:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290233:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385dee expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290248:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385df5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385dee expref: 13 pid: 5842 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.290262:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1876539541037696:0@lo:104: 00000100:00100000:3.0:1789607652.290328:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.290376:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607652.290399:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541037696 00000100:00100000:3.0:1789607652.290407:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541037696 00000100:00100000:3.0:1789607652.290473:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607652.290482:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:5863:x1876539541037696:12345-0@lo:104: 00010000:00010000:3.0:1789607652.290496:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385df5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290570:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607652.290577:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:5863:x1876539541037696:12345-0@lo:104: Request processed in 96us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607652.290584:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607652.290627:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1876539541037696:0@lo:104: 00010000:00010000:3.0:1789607652.290644:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290667:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607652.290672:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385df5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290679:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1511e00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607652.290682:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385dee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385df5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290691:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385df5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607652.290698:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385dee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385df5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607652.290702:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607652.290730:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385dee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385df5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290736:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607652.290751:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385dee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385df5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290758:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385dee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385df5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290774:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607652.290776:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607652.290778:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607652.290794:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541037824:0@lo:103: 00000100:00100000:3.0:1789607652.290828:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607652.290864:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541037824 00000100:00100000:3.0:1789607652.290869:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541037824 00010000:00010000:3.0:1789607652.290884:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385df5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385dee expref: 14 pid: 5842 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.290905:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607652.290913:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:3310:x1876539541037824:12345-0@lo:103: 00010000:00010000:3.0:1789607652.290937:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607652.290943:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385df5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385dee expref: 14 pid: 5842 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290952:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385df5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385dee expref: 14 pid: 5842 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290965:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385df5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385dee expref: 14 pid: 5842 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290978:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.290986:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789607652.290998:0:5834:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001187726s 00010000:00010000:3.0:1789607652.291002:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.291008:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.291025:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.291030:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.291034:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1510e00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:3.0:1789607652.291037:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.291045:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.291057:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.291066:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607652.291094:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c72050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:3310:x1876539541037824:12345-0@lo:103: Request processed in 182us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607652.291100:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789607652.291141:0:5863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.291149:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607652.291155:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c1510e00/0x33f091d001385e96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607652.291178:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541037824:0@lo:103: 00000100:00100000:1.0:1789607652.296139:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:6690:x1876539541037568:12345-0@lo:253: Request processed in 33835us (36526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607652.296154:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789607652.296256:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:6690:1876539541037568:0@lo:253: 10000000:01000000:3.0:1789607652.296271:0:6690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789607652.296274:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789607652.296276:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789607652.296277:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607652.296278:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607652.296279:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607652.296280:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607652.296282:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607652.296283:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607652.296284:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607652.296286:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607652.296287:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789607652.296301:0:6690:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789607652.301121:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607652.301328:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607652.301658:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607652.301852:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607652.302071:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607652.302313:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789607652.303724:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789607652.541474:0:6690:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789607652.541482:0:6690:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789607652.541660:0:6690:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789607652.541714:0:6690:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789607652.541732:0:6690:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789607652.541758:0:6690:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789607652.748229:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607653.772651:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789607653.772716:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789607653.772722:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a1c98a7800 from 21 10000000:01000000:0.0:1789607653.772729:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789607653.772784:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607653.772799:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607653.772813:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607653.772843:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541037952:0@lo:101: 00000100:00100000:0.0:1789607653.772938:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607653.773005:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c56efcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.773065:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541037952 00000100:00100000:3.0:1789607653.773076:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541037952 00000100:00100000:3.0:1789607653.773152:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789607653.773163:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5845:x1876539541037952:12345-0@lo:101: 00010000:00010000:3.0:1789607653.773181:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607653.773198:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c1510e00/0x33f091d001385ea4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385e9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.773226:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c1510e00/0x33f091d001385ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385e9d expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.773251:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c1510e00/0x33f091d001385ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385e9d expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.773261:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1510e00, rc 0) 00000100:00100000:3.0:1789607653.773305:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541037952:12345-0@lo:101: Request processed in 144us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.773312:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789607653.773457:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541037952:0@lo:101: 00010000:00010000:0.0:1789607653.773474:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607653.773496:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607653.773569:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541038080:0@lo:501: 00000100:00100000:0.0:1789607653.773594:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607653.773617:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c56efcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.773666:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541038080 00000100:00100000:3.0:1789607653.773670:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541038080 00000100:00100000:3.0:1789607653.773700:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789607653.773706:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541038080:12345-0@lo:501: 00000100:00100000:3.0:1789607653.774010:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541038080:12345-0@lo:501: Request processed in 303us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.774017:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789607653.774047:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541038080:0@lo:501: 00000100:00100000:3.0:1789607653.774074:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541038208:0@lo:503: 00000100:00100000:3.0:1789607653.774111:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.774123:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e02e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.774134:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541038208 00000100:00100000:3.0:1789607653.774137:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541038208 00000100:00100000:3.0:1789607653.774154:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789607653.774160:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541038208:12345-0@lo:503: 00000100:00100000:3.0:1789607653.774300:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541038208:12345-0@lo:503: Request processed in 140us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.774307:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789607653.774343:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541038208:0@lo:503: 00000100:00100000:3.0:1789607653.774642:0:6783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:6783:1876539541038336:0@lo:502: 00000100:00100000:3.0:1789607653.774678:0:6783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.774699:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541038336 00000100:00100000:3.0:1789607653.774702:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541038336 00000100:00100000:3.0:1789607653.774724:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789607653.774729:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6783:x1876539541038336:12345-0@lo:502: 00000100:00100000:3.0:1789607653.774865:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6783:x1876539541038336:12345-0@lo:502: Request processed in 135us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.774871:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789607653.774897:0:6783:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c4f0f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.774907:0:6783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:6783:1876539541038336:0@lo:502: 00000100:00100000:3.0:1789607653.774941:0:6783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:6783:1876539541038464:0@lo:502: 00000100:00100000:3.0:1789607653.774966:0:6783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.774980:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541038464 00000100:00100000:3.0:1789607653.774982:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541038464 00000100:00100000:3.0:1789607653.774997:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607653.775002:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6783:x1876539541038464:12345-0@lo:502: 00000100:00100000:3.0:1789607653.775092:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:6783:x1876539541038464:12345-0@lo:502: Request processed in 89us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.775098:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607653.775119:0:6783:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c4f0f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.775128:0:6783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:6783:1876539541038464:0@lo:502: 00000040:00080000:3.0:1789607653.775141:0:6783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789607653.775193:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789607653.775210:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789607653.775224:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775236:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607653.775246:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789607653.775249:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a1c98a7800 from 4 10000000:01000000:3.0:1789607653.775252:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789607653.775277:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775286:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775296:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607653.775305:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541038592:0@lo:101: 00000100:00100000:3.0:1789607653.775326:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.775336:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c4f0f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.775345:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541038592 00000100:00100000:3.0:1789607653.775347:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541038592 00000100:00100000:3.0:1789607653.775363:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789607653.775367:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541038592:12345-0@lo:101: 00010000:00010000:3.0:1789607653.775375:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607653.775387:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c1510800/0x33f091d001385eb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385eab expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775407:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c1510800/0x33f091d001385eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385eab expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775449:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c1510800/0x33f091d001385eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385eab expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775458:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1510800, rc 0) 00000100:00100000:3.0:1789607653.775484:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541038592:12345-0@lo:101: Request processed in 116us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.775490:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789607653.775514:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541038592:0@lo:101: 00010000:00010000:3.0:1789607653.775523:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775533:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607653.775587:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541038720:0@lo:256: 00000100:00100000:3.0:1789607653.775614:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.775624:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c4f0f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.775633:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541038720 00000100:00100000:3.0:1789607653.775636:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541038720 00000100:00100000:3.0:1789607653.775650:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789607653.775656:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541038720:12345-0@lo:256: 20000000:01000000:3.0:1789607653.775668:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789607653.775685:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789607653.775688:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789607653.775750:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541038720:12345-0@lo:256: Request processed in 94us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.775757:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789607653.775783:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541038720:0@lo:256: 10000000:01000000:3.0:1789607653.775818:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789607653.775823:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775832:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607653.775838:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789607653.775840:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789607653.775842:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789607653.775854:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775861:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775868:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607653.775877:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541038848:0@lo:101: 00000100:00100000:3.0:1789607653.775896:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.775906:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c4f0f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.775914:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541038848 00000100:00100000:3.0:1789607653.775917:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541038848 00000100:00100000:3.0:1789607653.775931:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789607653.775936:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541038848:12345-0@lo:101: 00010000:00010000:3.0:1789607653.775942:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607653.775949:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c1511200/0x33f091d001385ec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385eb9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775966:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c1511200/0x33f091d001385ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385eb9 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775974:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c1511200/0x33f091d001385ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385eb9 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.775981:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1511200, rc 0) 00000100:00100000:3.0:1789607653.776001:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541038848:12345-0@lo:101: Request processed in 65us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.776006:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789607653.776029:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541038848:0@lo:101: 00010000:00010000:3.0:1789607653.776037:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607653.776045:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607653.776079:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541038976:0@lo:501: 00000100:00100000:3.0:1789607653.776098:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.776107:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e02780 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.776115:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541038976 00000100:00100000:3.0:1789607653.776118:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541038976 00000100:00100000:3.0:1789607653.776132:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789607653.776136:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541038976:12345-0@lo:501: 00000100:00100000:3.0:1789607653.776348:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541038976:12345-0@lo:501: Request processed in 211us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.776354:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789607653.776383:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541038976:0@lo:501: 00000100:00100000:3.0:1789607653.776405:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541039104:0@lo:503: 00000100:00100000:3.0:1789607653.776463:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607653.776475:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e02780 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.776483:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541039104 00000100:00100000:3.0:1789607653.776486:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541039104 00000100:00100000:3.0:1789607653.776502:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789607653.776507:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541039104:12345-0@lo:503: 00000100:00100000:3.0:1789607653.781783:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541039104:12345-0@lo:503: Request processed in 5261us (5305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.781803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789607653.782602:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541039104:0@lo:503: 00000100:00100000:2.0:1789607653.787085:0:6784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:6784:1876539541039232:0@lo:502: 00000100:00100000:2.0:1789607653.787196:0:6784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607653.787265:0:6784:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8d9df00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.787334:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541039232 00000100:00100000:3.0:1789607653.787346:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541039232 00000100:00100000:3.0:1789607653.787404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789607653.787416:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:6784:x1876539541039232:12345-0@lo:502: 00000100:00100000:3.0:1789607653.787843:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:6784:x1876539541039232:12345-0@lo:502: Request processed in 427us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.787853:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789607653.788562:0:6784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:6784:1876539541039232:0@lo:502: 00000020:01000000:3.0:1789607653.788611:0:6784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789607653.788621:0:6784:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789607653.788630:0:6784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607653.788633:0:6784:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789607653.788639:0:6784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789607653.788643:0:6784:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.103@tcp to nid 0x20000c0a8ca67 (192.168.202.103@tcp) 00000020:01000000:3.0:1789607653.788672:0:6784:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789607653.788675:0:6784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607653.788704:0:6784:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99a1ff848000) 00000020:00000080:3.0:1789607653.788733:0:6784:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789607653.788739:0:6784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789607653.788833:0:6784:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789607653.788841:0:6784:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789607653.788849:0:6784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d001385ece 00010000:00080000:3.0:1789607653.788885:0:6784:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a1e4ce4000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:3.0:1789607653.789190:0:6784:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789607653.817936:0:6784:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1789607653.817969:0:6784:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789607653.818828:0:6784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607653.819008:0:6784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607653.819067:0:6784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1789607653.819212:0:6784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789607653.819771:0:6787:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607653.819775:0:6787:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789607653.827329:0:6784:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789607653.827352:0:6784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789607653.827408:0:6784:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789607653.829616:0:6784:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33f091d001385ed5 00000100:00080000:1.0:1789607653.829637:0:6784:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789607653.829655:0:6784:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99a1e4ce4000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1789607653.829725:0:6784:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a1f61c8380 x1876539541039360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789607653.829764:0:6784:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1789607653.829880:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541039360:0@lo:8: 00000020:01000000:1.0:1789607653.829886:0:6784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607653.829893:0:6784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607653.829895:0:6784:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789607653.829898:0:6784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607653.829903:0:6784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607653.829904:0:6784:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789607653.829906:0:6784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789607653.829908:0:6784:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789607653.829937:0:6784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:6784:1876539541039488:0@lo:502: 00000100:00100000:0.0:1789607653.829975:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607653.829991:0:6784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607653.830091:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541039360 00000100:00100000:2.0:1789607653.830099:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541039360 00000100:00100000:2.0:1789607653.830136:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607653.830145:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1876539541039360:12345-0@lo:8: 00010000:00080000:2.0:1789607653.830178:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 187 last 0 00000020:00000080:2.0:1789607653.830213:0:6692:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33f091d001385edc 00002000:00100000:2.0:1789607653.830263:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99a201cc4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789607653.830274:0:6692:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789607653.830279:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789607653.830713:0:6692:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789607653.830885:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789607653.830915:0:6692:0:(import.c:65:import_set_state_nolock()) ffff99a1f61b5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607653.830979:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876539541039360:12345-0@lo:8: Request processed in 834us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607653.830987:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607653.831084:0:6784:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08600 going to sleep for 11 seconds 00010000:00080000:0.0:1789607653.831330:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1f61c8380 x1876539541039360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607653.831342:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789607653.831351:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789607653.831361:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789607653.831366:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789607653.831369:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1e4ce4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789607653.831394:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789607653.831401:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541039360:0@lo:8: 00000100:00100000:0.0:1789607653.831610:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541039616:0@lo:400: 00000100:00100000:0.0:1789607653.831654:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607653.831683:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607653.831689:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541039744:0@lo:400: 00000100:00100000:0.0:1789607653.831714:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607653.831759:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541039616 00000100:00100000:0.0:1789607653.831775:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541039616 00000004:00080000:1.0:1789607653.831894:0:6787:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789607653.832045:0:6787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 187676621415ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789607653.832679:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541039744 00000100:00100000:0.0:1789607653.832685:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541039744 00000100:00100000:0.0:1789607653.832719:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607653.832729:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541039616:12345-0@lo:400: 00000100:00100000:2.0:1789607653.832749:0:5849:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789607653.832760:0:5849:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1789607653.832895:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607653.832902:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541039744:12345-0@lo:400: 00000100:00100000:3.0:1789607653.832953:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541039488 00000100:00100000:2.0:1789607653.832956:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541039744:12345-0@lo:400: Request processed in 55us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.832958:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541039488 00000100:00100000:2.0:1789607653.832963:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789607653.832985:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789607653.832991:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:6784:x1876539541039488:12345-0@lo:502: 00000100:00080000:1.0:1789607653.833334:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607653.833600:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541039616:12345-0@lo:400: Request processed in 872us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607653.833610:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789607653.833668:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ee18d500 x1876539541039744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607653.833685:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541039744:0@lo:400: 00010000:00080000:0.0:1789607653.833699:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ee18ed80 x1876539541039616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607653.833707:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541039616:0@lo:400: 00000100:00100000:3.0:1789607653.838181:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:6784:x1876539541039488:12345-0@lo:502: Request processed in 5171us (8170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607653.838203:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789607653.840672:0:6784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:6784:1876539541039488:0@lo:502: 00000020:01000000:1.0:1789607653.840747:0:6784:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607653.840757:0:6784:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607653.840760:0:6784:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789607653.840772:0:6784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789607653.841389:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789607653.841418:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789607653.842434:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607653.842452:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607653.842852:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789607653.842856:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99a1c6588000 from 1 10000000:01000000:1.0:1789607653.842861:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789607653.842913:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607653.842923:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607653.842937:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607653.842969:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541039872:0@lo:101: 00000100:00100000:1.0:1789607653.843062:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607653.843138:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607653.843240:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541039872 00000100:00100000:2.0:1789607653.843252:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541039872 00000100:00100000:2.0:1789607653.843316:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789607653.843328:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541039872:12345-0@lo:101: 00010000:00010000:2.0:1789607653.843347:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607653.843364:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385eea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385ee3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607653.843394:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385ee3 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607653.843406:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385ee3 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607653.843453:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d8d7e400, rc 0) 00000100:00100000:2.0:1789607653.843506:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541039872:12345-0@lo:101: Request processed in 180us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607653.843513:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789607653.843588:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541039872:0@lo:101: 00010000:00010000:2.0:1789607653.843606:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385eea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607653.843617:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385eea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607653.843679:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541040000:0@lo:501: 00000100:00100000:2.0:1789607653.843706:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607653.843727:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8d9d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607653.843738:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541040000 00000100:00100000:2.0:1789607653.843742:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541040000 00000100:00100000:2.0:1789607653.843760:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789607653.843765:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541040000:12345-0@lo:501: 00000100:00100000:2.0:1789607653.844017:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541040000:12345-0@lo:501: Request processed in 249us (309us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789607653.844025:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789607653.844057:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f06680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541040000:0@lo:501: 10000000:01000000:2.0:1789607653.844085:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789607653.844091:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385eea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607653.844108:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385eea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789607653.893839:0:6789:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789607653.893887:0:6789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6789:1876539541040256:0@lo:7: 00000100:00100000:2.0:1789607653.893986:0:6789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607653.894048:0:6789:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607653.894108:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541040128:0@lo:13: 00000100:00100000:2.0:1789607653.894139:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607653.894195:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541040256 00000100:00100000:2.0:1789607653.894205:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541040256 00000100:00100000:2.0:1789607653.894277:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607653.894288:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6789:x1876539541040256:12345-0@lo:7: 00000100:00100000:0.0:1789607653.897219:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541040128 00000100:00100000:0.0:1789607653.897291:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541040128 00000100:00100000:0.0:1789607653.897392:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789607653.897403:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876539541040128:12345-0@lo:13: 00002000:00000024:0.0:1789607653.897461:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:0.0:1789607653.897660:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876539541040128:12345-0@lo:13: Request processed in 258us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607653.897668:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789607653.898398:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1e8f06680 x1876539541040128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607669 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607653.898449:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541040128:0@lo:13: 00000100:00080000:3.0:1789607653.899367:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1789607653.908830:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789607653.908842:0:6695:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789607653.908977:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6789:x1876539541040256:12345-0@lo:7: Request processed in 14683us (14983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607653.908991:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789607653.909070:0:6789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1e8f05880 x1876539541040256/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789607669 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607653.909089:0:6789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6789:1876539541040256:0@lo:7: 00000004:00080000:2.0:1789607653.909109:0:6789:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789607653.909161:0:6789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6789:1876539541040384:0@lo:5: 00000100:00100000:2.0:1789607653.909200:0:6789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607653.909370:0:6789:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607653.909408:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541040384 00000100:00100000:2.0:1789607653.909416:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541040384 00000100:00100000:2.0:1789607653.909549:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607653.909560:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6789:x1876539541040384:12345-0@lo:5: 00002000:00080000:2.0:1789607653.909593:0:6694:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789607653.909597:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789607653.909890:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6789:x1876539541040384:12345-0@lo:5: Request processed in 331us (689us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789607653.909898:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789607653.909934:0:6789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1e8f05880 x1876539541040384/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607669 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607653.909947:0:6789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6789:1876539541040384:0@lo:5: 00000004:00080000:2.0:1789607653.909962:0:6789:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789607653.909991:0:6789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6789:1876539541040512:0@lo:700: 00000100:00100000:2.0:1789607653.910019:0:6789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607653.910050:0:6789:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607653.914362:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541040512 00000100:00100000:1.0:1789607653.914389:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541040512 00000100:00100000:1.0:1789607653.914492:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607653.914506:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6789:x1876539541040512:12345-0@lo:700: 00000100:00100000:1.0:1789607653.914597:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6701:1876539541040640:0@lo:700: 00000100:00100000:1.0:1789607653.914688:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607653.914740:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c089c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607653.926674:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541040640 00000100:00100000:3.0:1789607653.926699:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541040640 00000100:00100000:3.0:1789607653.926789:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607653.926802:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6701:x1876539541040640:12345-0@lo:700: 00000004:00080000:2.0:1789607653.967942:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1789607653.999834:0:5854:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1789607654.008376:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6701:x1876539541040640:12345-0@lo:700: Request processed in 81562us (93672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607654.008568:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789607654.009759:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1f61cbb80 x1876539541040640/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789607669 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607654.009782:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6701:1876539541040640:0@lo:700: 40000000:02000000:1.0:1789607654.009804:0:6701:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1789607654.153840:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6789:x1876539541040512:12345-0@lo:700: Request processed in 239327us (243809us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607654.153860:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789607654.153931:0:6789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1e8f05c00 x1876539541040512/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789607669 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607654.153948:0:6789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6789:1876539541040512:0@lo:700: 00000001:00080000:0.0:1789607654.154398:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1789607654.154411:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:2.0:1789607654.210839:0:6789:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1789607654.217456:0:6789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6789:1876539541040768:0@lo:5: 00000100:00100000:3.0:1789607654.219747:0:6789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607654.219803:0:6789:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff9a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607654.220126:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541040768 00000100:00100000:2.0:1789607654.220137:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541040768 00000100:00100000:2.0:1789607654.220200:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607654.220211:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6789:x1876539541040768:12345-0@lo:5: 00002000:00080000:1.0:1789607654.234004:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789607654.234032:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789607654.239778:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6789:x1876539541040768:12345-0@lo:5: Request processed in 19560us (20029us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789607654.239797:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789607654.239835:0:6789:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1e8f05c00 x1876539541040768/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607670 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607654.239850:0:6789:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789607654.239876:0:6789:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff99a1e8f05c00 x1876539541040768/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607670 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607654.239887:0:6789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6789:1876539541040768:0@lo:5: 00000004:00080000:2.0:1789607654.239903:0:6789:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1789607654.795528:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607655.824395:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607656.845752:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607657.868088:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607658.891659:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607659.151900:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541041024:0@lo:400: 00000100:00100000:0.0:1789607659.151975:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607659.152034:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607659.152040:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541041152:0@lo:400: 00000100:00100000:0.0:1789607659.152062:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607659.152111:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541041024 00000100:00100000:0.0:1789607659.152119:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541041024 00000100:00100000:0.0:1789607659.152164:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541041152 00000100:00100000:0.0:1789607659.152167:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541041152 00000100:00100000:0.0:1789607659.152197:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607659.152207:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541041024:12345-0@lo:400: 00000100:00100000:0.0:1789607659.152259:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541041024:12345-0@lo:400: Request processed in 54us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607659.152267:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607659.152285:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607659.152291:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541041152:12345-0@lo:400: 00000100:00100000:0.0:1789607659.152316:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541041152:12345-0@lo:400: Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607659.152321:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789607659.152355:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ee18f480 x1876539541041152/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607659.152368:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541041152:0@lo:400: 00010000:00080000:0.0:1789607659.152377:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ee18d500 x1876539541041024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607659.152384:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541041024:0@lo:400: 00000100:00100000:0.0:1789607659.152458:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541041280:0@lo:400: 00000100:00100000:0.0:1789607659.152499:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607659.152601:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607659.152608:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541040896:0@lo:400: 00000100:00100000:0.0:1789607659.152637:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607659.153221:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541041280 00000100:00100000:2.0:1789607659.153227:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541041280 00000100:00100000:2.0:1789607659.153277:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607659.153285:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876539541041280:12345-0@lo:400: 00000100:00100000:2.0:1789607659.153332:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876539541041280:12345-0@lo:400: Request processed in 48us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607659.153338:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607659.153358:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541040896 00000100:00100000:2.0:1789607659.153361:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541040896 00000100:00100000:2.0:1789607659.153380:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789607659.153386:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:3309:x1876539541040896:12345-0@lo:400: 00000100:00100000:2.0:1789607659.153413:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:3309:x1876539541040896:12345-0@lo:400: Request processed in 28us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607659.153419:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789607659.153477:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541040896:0@lo:400: 00010000:00080000:2.0:1789607659.153591:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ee18e300 x1876539541041280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607659.153603:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541041280:0@lo:400: 00000100:00080000:2.0:1789607659.158463:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607659.158475:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607659.175353:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541041408:0@lo:13: 00000100:00100000:2.0:1789607659.175442:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607659.175534:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541041408 00000100:00100000:2.0:1789607659.175542:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541041408 00000100:00100000:2.0:1789607659.175587:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607659.175596:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876539541041408:12345-0@lo:13: 00002000:00000024:2.0:1789607659.175627:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607659.175671:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876539541041408:12345-0@lo:13: Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607659.175677:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789607659.175720:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1e8f05880 x1876539541041408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607659.175740:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541041408:0@lo:13: 00000001:00080000:0.0:1789607659.332718:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:0.0:1789607659.874716:0:7063:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789607659.931418:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607660.945123:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607661.963785:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607662.988765:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607664.015419:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607664.267695:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541041664:0@lo:400: 00000100:00100000:0.0:1789607664.267785:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607664.267844:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607664.267850:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541041536:0@lo:400: 00000100:00100000:0.0:1789607664.267884:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607664.267914:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876539541041792:0@lo:400: 00000100:00100000:0.0:1789607664.267936:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607664.267952:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607664.267957:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541041920:0@lo:400: 00000100:00100000:0.0:1789607664.267981:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607664.268011:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541041664 00000100:00100000:0.0:1789607664.268018:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541041664 00000100:00100000:0.0:1789607664.268065:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541041792 00000100:00100000:0.0:1789607664.268069:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541041792 00000100:00100000:0.0:1789607664.268105:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607664.268116:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541041664:12345-0@lo:400: 00000100:00100000:0.0:1789607664.268160:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541041664:12345-0@lo:400: Request processed in 45us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607664.268175:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607664.268193:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607664.268200:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876539541041792:12345-0@lo:400: 00000100:00100000:3.0:1789607664.268715:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541042048:0@lo:13: 00000100:00100000:3.0:1789607664.268748:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607664.268784:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541042048 00000100:00100000:3.0:1789607664.268788:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541042048 00000100:00100000:3.0:1789607664.268816:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607664.268822:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541042048:12345-0@lo:13: 00002000:00000024:3.0:1789607664.268848:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607664.268883:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541042048:12345-0@lo:13: Request processed in 62us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607664.268889:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789607664.268926:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1e8f05880 x1876539541042048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607664.268935:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789607664.268953:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541042048:0@lo:13: 00000100:00100000:0.0:1789607664.269162:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876539541041792:12345-0@lo:400: Request processed in 34us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607664.269170:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607664.269192:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541041536 00000100:00100000:0.0:1789607664.269196:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541041536 00000100:00100000:0.0:1789607664.269219:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789607664.269225:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:3312:x1876539541041536:12345-0@lo:400: 00000100:00100000:0.0:1789607664.269335:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:3312:x1876539541041536:12345-0@lo:400: Request processed in 110us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607664.269341:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1789607664.269370:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607664.269375:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789607664.270051:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ee18e300 x1876539541041792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607664.270064:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876539541041792:0@lo:400: 00000100:00100000:0.0:1789607664.270217:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541041536:0@lo:400: 00010000:00080000:0.0:1789607664.270231:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ee18df80 x1876539541041664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607664.270392:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541041664:0@lo:400: 00000100:00100000:1.0:1789607664.272617:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541041920 00000100:00100000:1.0:1789607664.272629:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541041920 00000100:00100000:1.0:1789607664.272695:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607664.272706:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541041920:12345-0@lo:400: 00000100:00100000:1.0:1789607664.272802:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541041920:12345-0@lo:400: Request processed in 98us (4819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607664.272810:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789607664.272866:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ee18ed80 x1876539541041920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607664.272880:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541041920:0@lo:400: 00010000:00010000:0.0:1789607665.036777:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607666.063140:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607667.083815:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607668.107647:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607669.141535:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607669.388296:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607669.388324:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541042176:0@lo:13: 00000100:00100000:0.0:1789607669.393556:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607669.393583:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541042304:0@lo:400: 00000100:00100000:0.0:1789607669.393654:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607669.394092:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541042304 00000100:00100000:2.0:1789607669.394102:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541042304 00000100:00100000:2.0:1789607669.394157:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789607669.394167:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:3310:x1876539541042304:12345-0@lo:400: 00000100:00100000:2.0:1789607669.394404:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:3310:x1876539541042304:12345-0@lo:400: Request processed in 238us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607669.394413:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789607669.394478:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607669.394527:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541042176 00000100:00100000:3.0:1789607669.394532:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541042176 00000100:00100000:3.0:1789607669.394571:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607669.394579:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541042176:12345-0@lo:13: 00002000:00000024:3.0:1789607669.394606:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607669.394647:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201655880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541042176:12345-0@lo:13: Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607669.394653:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789607669.396487:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607669.396536:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1e8f05f80 x1876539541042176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607669.396561:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541042176:0@lo:13: 00000100:00100000:2.0:1789607669.397854:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607669.397881:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541042560:0@lo:400: 00000100:00100000:2.0:1789607669.397939:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607669.397981:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541042560 00000100:00100000:2.0:1789607669.397988:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541042560 00000100:00100000:2.0:1789607669.400216:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607669.400234:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541042560:12345-0@lo:400: 00000100:00100000:2.0:1789607669.400329:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541042560:12345-0@lo:400: Request processed in 100us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607669.400336:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789607669.400405:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1e8f06300 x1876539541042560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607669.400438:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541042560:0@lo:400: 00000100:00100000:2.0:1789607669.400463:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607669.400474:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541042432:0@lo:400: 00000100:00100000:2.0:1789607669.400520:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607669.400566:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541042432 00000100:00100000:2.0:1789607669.400573:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541042432 00000100:00100000:2.0:1789607669.400598:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607669.400605:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541042432:12345-0@lo:400: 00000100:00100000:2.0:1789607669.400637:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541042432:12345-0@lo:400: Request processed in 32us (117us total) trans 0 rc 0/0 00010000:00080000:1.0:1789607669.400656:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1e8f07480 x1876539541042432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607669.400665:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541042432:0@lo:400: 00000100:00100000:2.0:1789607669.400777:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1789607669.401259:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607669.401543:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541042304:0@lo:400: 00010000:00010000:0.0:1789607670.159302:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607671.181927:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607672.204932:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607673.229520:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789607674.065721:0:7634:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789607674.065725:0:7634:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789607674.065858:0:7634:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99a1e8ccd800 00000020:01000004:0.0:1789607674.065875:0:7634:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789607674.065888:0:7634:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789607674.065914:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99a1c8cf4d40) 00000020:00000080:0.0:1789607674.065937:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789607674.104884:0:7634:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789607674.105243:0:7634:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789607674.127852:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1789607674.131484:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789607674.131519:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1789607674.131565:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789607674.131581:0:7634:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1789607674.131822:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789607674.131832:0:7634:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789607674.131839:0:7634:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x33f091d001385ef8 00000020:01000004:0.0:1789607674.131845:0:7634:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789607674.131861:0:7634:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.103@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789607674.131863:0:7634:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789607674.131867:0:7634:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789607674.131881:0:7634:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789607674.131884:0:7634:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789607674.165085:0:7634:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789607674.165124:0:7634:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.103@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789607674.165128:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789607674.165129:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789607674.165131:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607674.165136:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607674.165137:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607674.165138:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607674.165139:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607674.165140:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789607674.165142:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789607674.165143:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607674.165144:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789607674.165147:0:7634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789607674.165149:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789607674.165150:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789607674.165151:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607674.165152:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607674.165153:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607674.165154:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607674.165154:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607674.165155:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789607674.165156:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789607674.165157:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607674.165157:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789607674.165183:0:7634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789607674.165201:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541042688:0@lo:253: 00000100:00100000:2.0:1789607674.165271:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607674.165398:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15540 going to sleep for 11 seconds 00000100:00100000:0.0:1789607674.165594:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541042688 00000100:00100000:0.0:1789607674.165609:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541042688 00000100:00100000:0.0:1789607674.165697:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789607674.165707:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:7634:x1876539541042688:12345-0@lo:253: 20000000:01000000:0.0:1789607674.165733:0:5842:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789607674.165737:0:5842:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789607674.165742:0:5842:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789607674.165745:0:5842:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789607674.167038:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607674.167247:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789607674.167263:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789607674.167302:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789607674.167310:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789607674.167337:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789607674.167402:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789607674.168257:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789607674.168279:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.103@tcp 20000000:01000000:0.0:1789607674.168281:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.103@tcp (null) (null) (null) 00000040:00080000:0.0:1789607674.168316:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789607674.168323:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789607674.168380:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789607674.168389:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.103@tcp (null) (null) 00000040:00080000:0.0:1789607674.168458:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789607674.168469:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789607674.168517:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789607674.168663:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789607674.171913:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789607674.171950:0:5842:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.103@tcp 20000000:01000000:0.0:1789607674.171953:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.103@tcp (null) (null) (null) 00000040:00080000:0.0:1789607674.171993:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789607674.172000:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789607674.172034:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789607674.172056:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.103@tcp (null) (null) 00000040:00080000:0.0:1789607674.172090:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789607674.172100:0:5842:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789607674.172146:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789607674.172180:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789607674.172196:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789607674.172199:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789607674.172205:0:5842:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789607674.172206:0:5842:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789607674.172208:0:5842:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789607674.172221:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789607674.172223:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789607674.172256:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789607674.172259:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789607674.173126:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789607674.173372:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789607674.173417:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789607674.173516:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789607674.173605:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789607674.173608:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789607674.174329:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789607674.174396:0:7637:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789607674.174487:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789607674.175136:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789607674.175178:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789607674.175264:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789607674.175279:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789607674.175282:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789607674.177045:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789607674.177124:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789607674.177181:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789607674.178051:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789607674.178101:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789607674.178162:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789607674.178175:0:5842:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789607674.178177:0:5842:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789607674.179273:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789607674.179366:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789607674.179403:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789607674.180387:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789607674.180783:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789607674.180866:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:0.0:1789607674.180890:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789607674.180921:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.180938:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d103ba00/0x33f091d001385e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385e49 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.180945:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d103a200/0x33f091d001385e7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385e73 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.180952:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1c1510e00/0x33f091d001385ea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385e9d expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.180958:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1c1511200/0x33f091d001385ec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385eb9 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.180964:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385eea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385ee3 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.180970:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.181007:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385ee3 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.181021:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385eea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385ee3 expref: 16 pid: 5841 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607674.181034:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541042816:0@lo:104: 00000100:00100000:0.0:1789607674.181105:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607674.181159:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1c1511200/0x33f091d001385ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385eb9 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.181178:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1c1511200/0x33f091d001385ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385eb9 expref: 16 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607674.181186:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541042944:0@lo:104: 00010000:00010000:0.0:1789607674.181216:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1c1510e00/0x33f091d001385ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385e9d expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.181223:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1c1510e00/0x33f091d001385ea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385e9d expref: 16 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607674.181231:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541043072:0@lo:104: 00010000:00010000:0.0:1789607674.181251:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d103a200/0x33f091d001385e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385e73 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.181258:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d103a200/0x33f091d001385e7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385e73 expref: 16 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607674.181264:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541043200:0@lo:104: 00010000:00010000:0.0:1789607674.181284:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d103ba00/0x33f091d001385e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385e49 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.181291:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d103ba00/0x33f091d001385e50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385e49 expref: 16 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607674.181298:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541043328:0@lo:104: 00000100:00100000:0.0:1789607674.181315:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff823180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607674.181579:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789607674.181598:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.181629:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.181639:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.181647:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.181658:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541042816 00000100:00100000:3.0:1789607674.181667:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541042816 00000100:00100000:3.0:1789607674.181838:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541042944 00000100:00100000:3.0:1789607674.181843:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541042944 00000100:00100000:3.0:1789607674.181854:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541043072 00000100:00100000:3.0:1789607674.181857:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541043072 00000100:00100000:3.0:1789607674.181877:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541043200 00000100:00100000:3.0:1789607674.181879:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541043200 00000100:00100000:3.0:1789607674.181887:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541043328 00000100:00100000:3.0:1789607674.181890:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541043328 00000100:00100000:3.0:1789607674.181902:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789607674.181910:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c3862050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+7:5842:x1876539541042816:12345-0@lo:104: 00010000:00010000:3.0:1789607674.181922:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385eea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.181985:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607674.181991:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c3862050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+7:5842:x1876539541042816:12345-0@lo:104: Request processed in 83us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.181998:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789607674.182040:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789607674.182046:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+6:5842:x1876539541042944:12345-0@lo:104: 00010000:00010000:3.0:1789607674.182054:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182085:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789607674.182089:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201655c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+6:5842:x1876539541042944:12345-0@lo:104: Request processed in 45us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.182095:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789607674.182108:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607674.182113:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201657800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:5842:x1876539541043072:12345-0@lo:104: 00010000:00010000:3.0:1789607674.182121:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182146:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789607674.182158:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201657800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:5842:x1876539541043072:12345-0@lo:104: Request processed in 45us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.182163:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789607674.182176:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607674.182182:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201656a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:5842:x1876539541043200:12345-0@lo:104: 00010000:00010000:3.0:1789607674.182190:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385e7a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182217:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789607674.182221:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201656a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:5842:x1876539541043200:12345-0@lo:104: Request processed in 40us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.182226:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607674.182236:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789607674.182242:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:5842:x1876539541043328:12345-0@lo:104: 00010000:00010000:3.0:1789607674.182248:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385e50 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182274:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789607674.182278:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201655f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:5842:x1876539541043328:12345-0@lo:104: Request processed in 37us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.182282:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789607674.182300:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789607674.182306:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385eea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182312:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c167dc00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607674.182316:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385eea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182335:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385eea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607674.182342:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385eea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607674.182357:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607674.182389:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385eea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182395:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607674.182413:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385eea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182420:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d001385ee3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385eea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182454:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789607674.182457:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182462:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1510200 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607674.182464:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182471:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607674.182477:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607674.182488:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607674.182502:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182507:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789607674.182659:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541042816:0@lo:104: 00000100:00100000:2.0:1789607674.182669:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541042944:0@lo:104: 00000100:00100000:2.0:1789607674.182684:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18e300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541043072:0@lo:104: 00000100:00100000:2.0:1789607674.182693:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541043200:0@lo:104: 00000100:00100000:2.0:1789607674.182699:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18c000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5842:1876539541043328:0@lo:104: 00010000:00010000:2.0:1789607674.182722:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182829:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182837:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c1510200/0x33f091d001385eb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385ec0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182848:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789607674.182851:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182856:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a000 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607674.182858:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182865:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607674.182870:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607674.182876:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607674.182889:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182896:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607674.182909:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182916:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d103a000/0x33f091d001385e9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385ea4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182926:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607674.182929:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385e7a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182935:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1511000 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607674.182938:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385e7a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182944:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385e7a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607674.182949:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385e7a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607674.182955:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607674.182967:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385e7a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182973:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607674.182978:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385e7a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182984:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d001385e73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385e7a expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.182994:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607674.183002:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385e50 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.183008:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1510a00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607674.183010:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385e50 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.183016:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385e50 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607674.183022:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385e50 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607674.183026:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607674.183039:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385e50 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.183044:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607674.183049:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385e50 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.183055:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c1510a00/0x33f091d001385e49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385e50 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.183068:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607674.183071:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607674.183072:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607674.183080:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607674.183099:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541043456:0@lo:103: 00000100:00100000:3.0:1789607674.183135:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.183175:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541043968:0@lo:103: 00000100:00100000:3.0:1789607674.183201:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.183223:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607674.183228:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541043840:0@lo:103: 00000100:00100000:3.0:1789607674.183263:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.183289:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541043584:0@lo:103: 00000100:00100000:3.0:1789607674.183320:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.183335:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607674.183339:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541043712:0@lo:103: 00000100:00100000:3.0:1789607674.183370:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.183396:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541043456 00000100:00100000:3.0:1789607674.183402:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541043456 00010000:00010000:3.0:1789607674.183452:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385eea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385ee3 expref: 17 pid: 5841 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607674.183469:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541043968 00000100:00100000:3.0:1789607674.183471:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541043968 00010000:00010000:3.0:1789607674.183483:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d103ba00/0x33f091d001385e50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385e49 expref: 18 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607674.183492:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541043840 00000100:00100000:3.0:1789607674.183494:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541043840 00010000:00010000:3.0:1789607674.183502:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d103a200/0x33f091d001385e7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385e73 expref: 19 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607674.183512:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541043584 00000100:00100000:3.0:1789607674.183513:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541043584 00010000:00010000:3.0:1789607674.183522:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1c1511200/0x33f091d001385ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385eb9 expref: 20 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607674.183714:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541043712 00000100:00100000:2.0:1789607674.183718:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541043712 00010000:00010000:2.0:1789607674.183734:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1c1510e00/0x33f091d001385ea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385e9d expref: 21 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607674.183750:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607674.183757:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+21:3312:x1876539541043456:12345-0@lo:103: 00010000:00010000:2.0:1789607674.183768:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607674.183774:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385eea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385ee3 expref: 21 pid: 5841 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.183784:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385eea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385ee3 expref: 21 pid: 5841 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.183797:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385eea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385ee3 expref: 21 pid: 5841 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.183811:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607674.183844:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201657480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+20:3312:x1876539541043456:12345-0@lo:103: Request processed in 88us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.183850:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607674.183869:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607674.183875:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201656d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3312:x1876539541043968:12345-0@lo:103: 00010000:00010000:2.0:1789607674.183882:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607674.183886:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d103ba00/0x33f091d001385e50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385e49 expref: 19 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.183894:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d103ba00/0x33f091d001385e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385e49 expref: 19 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.183910:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103ba00/0x33f091d001385e50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385e49 expref: 19 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.183918:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607674.183944:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201656d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:3312:x1876539541043968:12345-0@lo:103: Request processed in 69us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.183949:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607674.183963:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607674.183968:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201657b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:3312:x1876539541043840:12345-0@lo:103: 00010000:00010000:2.0:1789607674.183976:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607674.183979:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d103a200/0x33f091d001385e7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385e73 expref: 17 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.183987:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d103a200/0x33f091d001385e7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385e73 expref: 17 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.183996:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103a200/0x33f091d001385e7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385e73 expref: 17 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.184004:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607674.184024:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201657b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:3312:x1876539541043840:12345-0@lo:103: Request processed in 57us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.184030:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607674.184042:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607674.184048:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:3309:x1876539541043712:12345-0@lo:103: 00010000:00010000:2.0:1789607674.184055:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607674.184059:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1c1510e00/0x33f091d001385ea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385e9d expref: 15 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.184072:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1c1510e00/0x33f091d001385ea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385e9d expref: 15 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.184082:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c1510e00/0x33f091d001385ea4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385e9d expref: 15 pid: 5842 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.184091:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607674.184119:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:3309:x1876539541043712:12345-0@lo:103: Request processed in 71us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.184125:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789607674.184471:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541043840:0@lo:103: 00000100:00100000:0.0:1789607674.184494:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201656300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541043456:0@lo:103: 00000100:00100000:0.0:1789607674.184500:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201656680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541043968:0@lo:103: 00000100:00100000:3.0:1789607674.184998:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789607674.185014:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee291f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:3309:x1876539541043584:12345-0@lo:103: 00010000:00010000:3.0:1789607674.185026:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607674.185030:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1c1511200/0x33f091d001385ec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385eb9 expref: 13 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.185040:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1c1511200/0x33f091d001385ec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385eb9 expref: 13 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.185051:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c1511200/0x33f091d001385ec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385eb9 expref: 13 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.185063:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.185071:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.185085:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.185092:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.185099:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.185105:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.185110:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b000 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:3.0:1789607674.185114:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.185131:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.185334:0:5842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.185344:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789607674.185360:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1789607674.186398:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.186412:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103b000/0x33f091d001385eff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607674.186499:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541043712:0@lo:103: 00010000:00010000:3.0:1789607674.186663:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607674.188637:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee291f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:3309:x1876539541043584:12345-0@lo:103: Request processed in 3617us (5308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.188652:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789607674.189145:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541043584:0@lo:103: 00010000:00010000:3.0:1789607674.256483:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607674.269233:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:7634:x1876539541042688:12345-0@lo:253: Request processed in 103519us (103952us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.269249:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789607674.270012:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f04380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541042688:0@lo:253: 10000000:01000000:1.0:1789607674.270058:0:7634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789607674.270061:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789607674.270063:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789607674.270064:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607674.270066:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789607674.270067:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607674.270068:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607674.270069:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789607674.270071:0:7634:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789607674.270073:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607674.270074:0:7634:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789607674.270096:0:7634:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99a1e8ccd800 from lustre-OST0001 10000000:01000000:1.0:1789607674.270122:0:7634:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789607674.270125:0:7634:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789607674.270132:0:7634:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99a1c6588000 local copy 10000000:01000000:1.0:1789607674.270136:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789607674.270172:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.270182:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.270191:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607674.270210:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044096:0@lo:101: 00000100:00100000:1.0:1789607674.270254:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607674.270461:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541044096 00000100:00100000:2.0:1789607674.270468:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541044096 00000100:00100000:2.0:1789607674.270507:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789607674.270515:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+11:7634:x1876539541044096:12345-0@lo:101: 00010000:00010000:2.0:1789607674.270536:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607674.270550:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385f0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385f06 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.270571:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385f06 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.270594:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f06 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.270604:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d8d7e400, rc 0) 00000100:00100000:2.0:1789607674.270634:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:7634:x1876539541044096:12345-0@lo:101: Request processed in 121us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.270641:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789607674.270960:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607674.270977:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044096:0@lo:101: 00010000:00010000:1.0:1789607674.270991:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x33f091d001385f0d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.271010:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x33f091d001385f0d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607674.271179:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044224:0@lo:501: 00000100:00100000:1.0:1789607674.271220:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607674.271240:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873300 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.271487:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541044224 00000100:00100000:2.0:1789607674.271492:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541044224 00000100:00100000:2.0:1789607674.271533:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789607674.271541:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:7634:x1876539541044224:12345-0@lo:501: 00000100:00100000:2.0:1789607674.271935:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:7634:x1876539541044224:12345-0@lo:501: Request processed in 394us (713us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789607674.271944:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789607674.272127:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044224:0@lo:501: 10000000:01000000:1.0:1789607674.272144:0:7634:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789607674.272171:0:7634:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789607674.272177:0:7634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x33f091d001385f0d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.272186:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x33f091d001385f0d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.272192:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x33f091d001385f0d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.272215:0:7634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789607674.272235:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99a1e8ccd800 10000000:01000000:1.0:1789607674.272240:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789607674.272244:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789607674.272246:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789607674.272250:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789607674.272253:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789607674.272275:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.272373:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607674.272380:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x400000000 nid: local remote: 0x33f091d001385f0d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.272409:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.272418:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607674.272464:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044352:0@lo:101: 00000100:00100000:1.0:1789607674.272497:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607674.272522:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.272637:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541044352 00000100:00100000:2.0:1789607674.272642:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541044352 00000100:00100000:2.0:1789607674.272685:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789607674.272693:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:7634:x1876539541044352:12345-0@lo:101: 00010000:00010000:2.0:1789607674.272702:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607674.272713:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385f1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385f14 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.272731:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385f14 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.272741:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f14 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.272759:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d8d7fa00, rc 0) 00000100:00100000:2.0:1789607674.272921:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541044352:12345-0@lo:101: Request processed in 227us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.272928:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789607674.273006:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044352:0@lo:101: 00010000:00010000:3.0:1789607674.273188:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c167d400 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607674.273193:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x33f091d001385f0d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.273203:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x33f091d001385f0d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607674.273209:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x33f091d001385f0d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607674.273214:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607674.273236:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x33f091d001385f0d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.273241:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789607674.273310:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1789607674.273448:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x33f091d001385f0d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.273456:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c167d400/0x33f091d001385f06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x33f091d001385f0d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.273470:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607674.273472:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607674.273473:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607674.273612:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f1b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.273622:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385f1b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607674.277170:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044608:0@lo:501: 00000100:00100000:1.0:1789607674.277242:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607674.277395:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607674.277477:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541044480:0@lo:103: 00000100:00100000:0.0:1789607674.277507:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607674.277622:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541044480 00000100:00100000:2.0:1789607674.277639:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541044480 00000100:00100000:2.0:1789607674.277702:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607674.277710:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:3310:x1876539541044480:12345-0@lo:103: 00010000:00010000:2.0:1789607674.277722:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607674.277740:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d8d7e400/0x33f091d001385f0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d001385f06 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.277757:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607674.277989:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541044608 00000100:00100000:3.0:1789607674.277994:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541044608 00000100:00100000:3.0:1789607674.278208:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789607674.278218:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541044608:12345-0@lo:501: 00000100:00100000:2.0:1789607674.278521:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:3310:x1876539541044480:12345-0@lo:103: Request processed in 811us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.278539:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607674.278893:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541044480:0@lo:103: 00000100:00100000:3.0:1789607674.279130:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:7634:x1876539541044608:12345-0@lo:501: Request processed in 914us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.279137:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789607674.279203:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044608:0@lo:501: 00000100:00100000:1.0:1789607674.279244:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044736:0@lo:503: 00000100:00100000:1.0:1789607674.283514:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607674.283918:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.284122:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541044736 00000100:00100000:2.0:1789607674.284133:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541044736 00000100:00100000:2.0:1789607674.284231:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789607674.284242:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:7634:x1876539541044736:12345-0@lo:503: 00000100:00100000:2.0:1789607674.284998:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:7634:x1876539541044736:12345-0@lo:503: Request processed in 755us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.285010:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789607674.286635:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044736:0@lo:503: 00000040:00080000:3.0:1789607674.287259:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607674.287496:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044864:0@lo:502: 00000100:00100000:3.0:1789607674.292018:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.292196:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff9a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.292258:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541044864 00000100:00100000:2.0:1789607674.292269:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541044864 00000100:00100000:2.0:1789607674.292489:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789607674.292499:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:7634:x1876539541044864:12345-0@lo:502: 00000100:00100000:2.0:1789607674.294019:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:7634:x1876539541044864:12345-0@lo:502: Request processed in 1516us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.294154:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044864:0@lo:502: 00000100:00100000:2.0:1789607674.294371:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000040:00080000:3.0:1789607674.294971:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789607674.295140:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789607674.295200:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789607674.295262:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789607674.295615:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789607674.295783:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789607674.295901:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044992:0@lo:502: 00000100:00100000:3.0:1789607674.295977:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.296123:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff9a1180 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.296193:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541044992 00000100:00100000:2.0:1789607674.296201:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541044992 00000100:00100000:2.0:1789607674.296249:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789607674.296258:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:7634:x1876539541044992:12345-0@lo:502: 00000100:00100000:2.0:1789607674.297257:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:7634:x1876539541044992:12345-0@lo:502: Request processed in 996us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.297269:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789607674.300309:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541044992:0@lo:502: 00000040:00080000:3.0:1789607674.300547:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789607674.300567:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789607674.302109:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789607674.302122:0:7641:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789607674.302130:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607674.302132:0:7641:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789607674.302137:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607674.302155:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99a1ff84cd40) 00000020:00000080:3.0:1789607674.302179:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789607674.302186:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789607674.302246:0:7641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a1e8ccd800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789607674.302254:0:7641:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789607674.302260:0:7641:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x33f091d001385f29 00010000:00010000:3.0:1789607674.308394:0:7641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789607674.309084:0:7641:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789607674.321100:0:7641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789607674.325048:0:7641:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789607674.333069:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789607674.335151:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789607674.339973:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789607674.339986:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607674.339993:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607674.339995:0:7641:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789607674.340000:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607674.340005:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607674.340006:0:7641:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789607674.340009:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789607674.340012:0:7641:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789607674.340074:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607674.340078:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607674.340079:0:7641:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789607674.340082:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789607674.340268:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789607674.340315:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789607674.340341:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f1b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.340361:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f1b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607674.340370:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1e8ccd800 from 1 10000000:01000000:2.0:1789607674.340373:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607674.340408:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.340416:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.340452:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607674.340478:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f06d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045120:0@lo:101: 00000100:00100000:2.0:1789607674.340689:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607674.340731:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541045120 00000100:00100000:2.0:1789607674.340737:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541045120 00000100:00100000:2.0:1789607674.340957:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789607674.340969:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:7634:x1876539541045120:12345-0@lo:101: 00010000:00010000:2.0:1789607674.340983:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607674.340995:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d8d7e800/0x33f091d001385f37 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385f30 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.341018:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d8d7e800/0x33f091d001385f37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385f30 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.341029:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d8d7e800/0x33f091d001385f37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f30 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.341037:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d8d7e800, rc 0) 00000100:00100000:2.0:1789607674.341071:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541045120:12345-0@lo:101: Request processed in 105us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.341078:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789607674.341122:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c5081f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.341143:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f06d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045120:0@lo:101: 00010000:00010000:2.0:1789607674.341157:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f37 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.341177:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385f37 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607674.341259:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f06d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045248:0@lo:501: 00000100:00100000:2.0:1789607674.344382:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607674.344465:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e4e02b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607674.344822:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541045248 00000100:00100000:1.0:1789607674.344831:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541045248 00000100:00100000:1.0:1789607674.345011:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789607674.345030:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541045248:12345-0@lo:501: 00000100:00100000:1.0:1789607674.346320:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541045248:12345-0@lo:501: Request processed in 1286us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607674.346332:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607674.348488:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f06d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045248:0@lo:501: 00000100:00100000:3.0:1789607674.348562:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045376:0@lo:503: 00000100:00100000:3.0:1789607674.348644:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.348689:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8ead0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607674.350823:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541045376 00000100:00100000:0.0:1789607674.350835:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541045376 00000100:00100000:0.0:1789607674.350889:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789607674.350907:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541045376:12345-0@lo:503: 00000100:00100000:0.0:1789607674.351316:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541045376:12345-0@lo:503: Request processed in 410us (2671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607674.351324:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789607674.352465:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045376:0@lo:503: 00000040:00080000:3.0:1789607674.352810:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607674.352887:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045504:0@lo:502: 00000100:00100000:3.0:1789607674.352953:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.352986:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8d4ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.353213:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541045504 00000100:00100000:2.0:1789607674.353221:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541045504 00000100:00100000:2.0:1789607674.353266:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789607674.353275:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541045504:12345-0@lo:502: 00000100:00100000:2.0:1789607674.353551:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541045504:12345-0@lo:502: Request processed in 277us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.353559:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789607674.353896:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045504:0@lo:502: 00000040:00080000:3.0:1789607674.354146:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789607674.354204:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789607674.354234:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045632:0@lo:502: 00000100:00100000:3.0:1789607674.354275:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.354313:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8d4ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.355307:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541045632 00000100:00100000:2.0:1789607674.355316:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541045632 00000100:00100000:2.0:1789607674.355377:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789607674.355387:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541045632:12345-0@lo:502: 00000100:00100000:2.0:1789607674.356481:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541045632:12345-0@lo:502: Request processed in 1092us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.356492:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789607674.358768:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045632:0@lo:502: 00000040:00080000:0.0:1789607674.358955:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789607674.358970:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789607674.360340:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607674.360364:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607674.360366:0:7645:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789607674.360374:0:7645:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a1e8ccd800 00000020:00000080:3.0:1789607674.360377:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607674.360405:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607674.360408:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607674.360409:0:7645:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789607674.360412:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789607674.360905:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789607674.360932:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789607674.360955:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f37 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.360967:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f37 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607674.361010:0:7634:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789607674.361013:0:7634:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99a1e8ccd800 10000000:01000000:0.0:1789607674.361016:0:7634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99a1e8ccd800 10000000:01000000:0.0:1789607674.361020:0:7634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607674.361025:0:7634:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a1e8ccd800 from 1 10000000:01000000:0.0:1789607674.361028:0:7634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789607674.361067:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.361076:0:7634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.361087:0:7634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607674.361126:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045760:0@lo:101: 00000100:00100000:0.0:1789607674.361193:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607674.361231:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff823240 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.361414:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541045760 00000100:00100000:2.0:1789607674.361455:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541045760 00000100:00100000:2.0:1789607674.361497:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789607674.361507:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541045760:12345-0@lo:101: 00010000:00010000:2.0:1789607674.361521:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607674.361545:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d8d7f800/0x33f091d001385f45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385f3e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.361574:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d8d7f800/0x33f091d001385f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385f3e expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.361584:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d8d7f800/0x33f091d001385f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f3e expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.361592:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d8d7f800, rc 0) 00000100:00100000:2.0:1789607674.361641:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7634:x1876539541045760:12345-0@lo:101: Request processed in 135us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.361647:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789607674.362024:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045760:0@lo:101: 00010000:00010000:0.0:1789607674.362039:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f45 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607674.362049:0:7634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385f45 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607674.362146:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045888:0@lo:501: 00000100:00100000:0.0:1789607674.362174:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607674.362194:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff823240 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.362305:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541045888 00000100:00100000:2.0:1789607674.362310:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541045888 00000100:00100000:2.0:1789607674.362351:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789607674.362360:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7634:x1876539541045888:12345-0@lo:501: 00000100:00100000:2.0:1789607674.363029:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7634:x1876539541045888:12345-0@lo:501: Request processed in 667us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.363037:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789607674.367939:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541045888:0@lo:501: 00000100:00100000:0.0:1789607674.368086:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541046016:0@lo:503: 00000100:00100000:0.0:1789607674.368177:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607674.368270:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff8239c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.368380:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541046016 00000100:00100000:2.0:1789607674.368389:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541046016 00000100:00100000:2.0:1789607674.368916:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789607674.368928:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7634:x1876539541046016:12345-0@lo:503: 00000100:00100000:2.0:1789607674.369152:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7634:x1876539541046016:12345-0@lo:503: Request processed in 226us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.369160:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789607674.369241:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541046016:0@lo:503: 00000040:00080000:0.0:1789607674.369599:0:7634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789607674.369673:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541046144:0@lo:502: 00000100:00100000:0.0:1789607674.369728:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607674.370164:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff8239c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607674.370365:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541046144 00000100:00100000:1.0:1789607674.370372:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541046144 00000100:00100000:1.0:1789607674.370404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789607674.370417:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7634:x1876539541046144:12345-0@lo:502: 00000100:00100000:1.0:1789607674.371076:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7634:x1876539541046144:12345-0@lo:502: Request processed in 662us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607674.371085:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789607674.371233:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541046144:0@lo:502: 00000040:00080000:0.0:1789607674.372043:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789607674.372110:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789607674.372145:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789607674.372200:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789607674.372247:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789607674.374063:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789607674.374151:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789607674.374187:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789607674.374257:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789607674.374307:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789607674.374355:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789607674.374405:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789607674.374460:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789607674.374508:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789607674.376370:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789607674.376447:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789607674.376484:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789607674.376994:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789607674.377040:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789607674.377074:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789607674.377124:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789607674.377162:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789607674.377194:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789607674.377264:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789607674.377510:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789607674.377629:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789607674.377895:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789607674.377938:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1789607674.377973:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789607674.378041:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789607674.378076:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789607674.378109:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789607674.378138:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789607674.378182:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789607674.378214:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789607674.378258:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789607674.378387:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789607674.378561:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541046272:0@lo:502: 00000100:00100000:0.0:1789607674.378653:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607674.378898:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff8239c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.378976:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541046272 00000100:00100000:2.0:1789607674.378985:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541046272 00000100:00100000:2.0:1789607674.379037:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789607674.379052:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7634:x1876539541046272:12345-0@lo:502: 00000100:00100000:2.0:1789607674.379264:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7634:x1876539541046272:12345-0@lo:502: Request processed in 212us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.379272:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789607674.379342:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541046272:0@lo:502: 00000040:00080000:2.0:1789607674.379464:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1789607674.379477:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789607674.383878:0:7646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789607674.383895:0:7646:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99a1f61a19c0) 00000020:00000080:2.0:1789607674.383919:0:7646:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789607674.383997:0:7646:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a1e8ccd800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789607674.384002:0:7646:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a1e8ccd800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789607674.384005:0:7646:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a1e8ccd800 3 00010000:00080000:2.0:1789607674.384037:0:7646:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a1f500b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.103@tcp at head 00010000:00010000:0.0:1789607674.388261:0:7646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1789607674.388866:0:7646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789607674.388909:0:7646:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789607674.388924:0:7646:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x33f091d001385f53 00000100:00080000:0.0:1789607674.388934:0:7646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607674.388946:0:7646:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99a1f500b800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1789607674.388984:0:7646:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a1ee18e680 x1876539541046400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607674.389054:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876539541046400:0@lo:38: 00000100:00100000:2.0:1789607674.389124:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.389208:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541046400 00000100:00100000:3.0:1789607674.389215:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541046400 00000100:00100000:3.0:1789607674.389253:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607674.389260:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876539541046400:12345-0@lo:38: 00010000:00080000:3.0:1789607674.389283:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1789607674.389322:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x33f091d001385f5a 00000004:00100000:3.0:1789607674.389336:0:5847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789607674.389376:0:5847:0:(import.c:65:import_set_state_nolock()) ffff99a1e4ce6800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789607674.389450:0:7646:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789607674.392662:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876539541046400:12345-0@lo:38: Request processed in 3392us (3527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.392688:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607674.393203:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607674.393219:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541046528:0@lo:400: 00000100:00100000:1.0:1789607674.393279:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607674.394927:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541046656:0@lo:400: 00000100:00100000:1.0:1789607674.394977:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607674.395002:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607674.395010:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541046784:0@lo:400: 00000100:00100000:1.0:1789607674.395035:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607674.395070:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541046528 00000100:00100000:1.0:1789607674.395077:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541046528 00000100:00100000:1.0:1789607674.395116:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541046656 00000100:00100000:1.0:1789607674.395119:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541046656 00000100:00100000:1.0:1789607674.395144:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607674.395151:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541046528:12345-0@lo:400: 00000100:00100000:1.0:1789607674.395203:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541046528:12345-0@lo:400: Request processed in 52us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607674.395220:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789607674.395236:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607674.395242:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541046656:12345-0@lo:400: 00000100:00100000:1.0:1789607674.395273:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541046656:12345-0@lo:400: Request processed in 32us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607674.395279:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607674.395932:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541046784 00000100:00100000:1.0:1789607674.395940:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541046784 00000100:00100000:1.0:1789607674.395979:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607674.395985:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541046784:12345-0@lo:400: 00000100:00100000:1.0:1789607674.396025:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541046784:12345-0@lo:400: Request processed in 40us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607674.396030:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789607674.396051:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789607674.396057:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789607674.396087:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1f61cb100 x1876539541046528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607674.396101:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541046528:0@lo:400: 00010000:00080000:1.0:1789607674.396131:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1f61c9f80 x1876539541046784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607674.396139:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541046784:0@lo:400: 00010000:00080000:1.0:1789607674.396148:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1f61c8e00 x1876539541046656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607674.396155:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541046656:0@lo:400: 00010000:00080000:2.0:1789607674.398487:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ee18e680 x1876539541046400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607674.398502:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789607674.398511:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789607674.398520:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789607674.398534:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789607674.398538:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1f500b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789607674.398545:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876539541046400:0@lo:38: 00000040:00080000:0.0:1789607674.403649:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789607674.403994:0:7634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789607674.404020:0:7634:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789607674.404058:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f45 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607674.404070:0:7634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f45 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789607674.404119:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789607674.404121:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789607674.404123:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607674.404124:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607674.404125:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607674.404127:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607674.404128:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607674.404129:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607674.404131:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607674.404132:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607674.404134:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607674.404138:0:7634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789607674.404140:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607674.404142:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789607674.404143:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607674.404144:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607674.404145:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607674.404146:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607674.404147:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607674.404148:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607674.404149:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607674.404150:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607674.404151:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607674.404189:0:7634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789607674.404208:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541046912:0@lo:253: 00000100:00100000:3.0:1789607674.404273:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607674.404321:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8d4ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607674.404487:0:7648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7648:1876539541047040:0@lo:901: 00000100:00100000:1.0:1789607674.404542:0:7648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607674.404560:0:7648:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873240 going to sleep for 11 seconds 00000100:00100000:3.0:1789607674.404686:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541047040 00000100:00100000:3.0:1789607674.404694:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541047040 00000100:00100000:3.0:1789607674.404750:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789607674.404765:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7648:x1876539541047040:12345-0@lo:901: 00000100:00100000:3.0:1789607674.405121:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7648:x1876539541047040:12345-0@lo:901: Request processed in 355us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607674.405128:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789607674.405378:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789607674.405409:0:7648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1f61c8e00 x1876539541047040/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789607690 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607674.405452:0:7648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7648:1876539541047040:0@lo:901: 00000100:00100000:2.0:1789607674.406152:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541046912 00000100:00100000:2.0:1789607674.406160:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541046912 00000100:00100000:2.0:1789607674.406268:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789607674.406279:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7634:x1876539541046912:12345-0@lo:253: 20000000:01000000:2.0:1789607674.406314:0:5842:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789607674.406329:0:5842:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789607674.439539:0:5842:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789607674.439561:0:5842:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789607674.439752:0:5863:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789607674.439758:0:5863:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789607674.439781:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.439881:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1c1510800/0x33f091d001385eb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385eab expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.439890:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.439930:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1c1510800/0x33f091d001385eb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385eab expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.439945:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1c1510800/0x33f091d001385eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385eab expref: 14 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607674.439959:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1876539541047168:0@lo:104: 00000100:00100000:1.0:1789607674.440029:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607674.440079:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607674.440397:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541047168 00000100:00100000:2.0:1789607674.440406:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541047168 00000100:00100000:2.0:1789607674.440471:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607674.440481:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:5863:x1876539541047168:12345-0@lo:104: 00010000:00010000:2.0:1789607674.440494:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.440561:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789607674.440568:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:5863:x1876539541047168:12345-0@lo:104: Request processed in 89us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.440574:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1789607674.440598:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607674.440604:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.440611:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1511e00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607674.440616:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.440623:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607674.440631:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607674.440655:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789607674.440882:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.440891:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607674.440911:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.440919:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c1511e00/0x33f091d001385eab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385eb2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.440936:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607674.440938:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607674.440940:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607674.440948:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607674.440959:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541047296:0@lo:103: 00000100:00100000:2.0:1789607674.440994:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607674.441025:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541047296 00000100:00100000:2.0:1789607674.441029:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541047296 00010000:00010000:2.0:1789607674.441047:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1c1510800/0x33f091d001385eb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385eab expref: 15 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607674.441070:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607674.441077:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c71450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:3310:x1876539541047296:12345-0@lo:103: 00010000:00010000:2.0:1789607674.441087:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607674.441092:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1c1510800/0x33f091d001385eb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385eab expref: 15 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.441101:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1c1510800/0x33f091d001385eb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385eab expref: 15 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.441124:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.441132:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789607674.441145:0:5833:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001388786s 00010000:00010000:2.0:1789607674.441150:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.441156:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.441162:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.441168:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.441172:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c167d400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607674.441176:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.441183:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.441191:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607674.441200:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607674.441228:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c71450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:3310:x1876539541047296:12345-0@lo:103: Request processed in 152us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607674.441241:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607674.441383:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541047296:0@lo:103: 00010000:00010000:1.0:1789607674.441971:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c1510800/0x33f091d001385eb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385eab expref: 14 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607674.441985:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5863:1876539541047168:0@lo:104: 00010000:00010000:1.0:1789607674.442012:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.442021:0:5863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.442027:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607674.442033:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167d400/0x33f091d001385f61 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607674.454405:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:7634:x1876539541046912:12345-0@lo:253: Request processed in 48117us (50120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607674.454419:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789607674.454657:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d7ee8c63-baa9-4366-97c9-8054ab743e80:7634:1876539541046912:0@lo:253: 10000000:01000000:3.0:1789607674.454752:0:7634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789607674.454756:0:7634:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789607674.454758:0:7634:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789607674.454760:0:7634:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607674.454761:0:7634:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607674.454762:0:7634:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607674.454763:0:7634:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607674.454764:0:7634:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607674.454766:0:7634:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789607674.454767:0:7634:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789607674.454769:0:7634:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607674.454770:0:7634:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789607674.454858:0:7634:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789607674.460957:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607674.461170:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607674.461475:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607674.461880:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789607674.462070:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789607674.462657:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789607674.464280:0:7634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789607674.511196:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607674.511224:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541047424:0@lo:13: 00000100:00100000:1.0:1789607674.511307:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607674.511387:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541047424 00000100:00100000:1.0:1789607674.511395:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541047424 00000100:00100000:1.0:1789607674.511462:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607674.511472:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541047424:12345-0@lo:13: 00002000:00000024:1.0:1789607674.511506:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607674.511565:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541047424:12345-0@lo:13: Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607674.511571:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789607674.511614:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ee290700 x1876539541047424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607674.511634:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541047424:0@lo:13: 00002000:00080000:0.0:1789607674.737070:0:7634:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789607674.737077:0:7634:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789607674.737116:0:7634:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789607674.737171:0:7634:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789607674.737201:0:7634:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789607674.737250:0:7634:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789607675.275768:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607676.300590:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607677.324679:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607678.351969:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607679.382575:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607679.631402:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541047552:0@lo:13: 00000100:00100000:1.0:1789607679.631504:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607679.631647:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541047552 00000100:00100000:2.0:1789607679.631656:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541047552 00000100:00100000:2.0:1789607679.631712:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607679.631721:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541047552:12345-0@lo:13: 00002000:00000024:2.0:1789607679.631756:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607679.631799:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541047552:12345-0@lo:13: Request processed in 79us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607679.631806:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607679.636133:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876539541047936:0@lo:400: 00000100:00100000:0.0:1789607679.636201:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607679.636500:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541047680:0@lo:400: 00000100:00100000:2.0:1789607679.636542:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607679.636576:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607679.636582:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876539541048064:0@lo:400: 00000100:00100000:2.0:1789607679.636606:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607679.636637:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541047680 00000100:00100000:2.0:1789607679.636645:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541047680 00000100:00100000:2.0:1789607679.636693:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789607679.636701:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:3312:x1876539541047680:12345-0@lo:400: 00000100:00100000:2.0:1789607679.636753:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:3312:x1876539541047680:12345-0@lo:400: Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607679.636761:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789607679.636793:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541047936 00000100:00100000:2.0:1789607679.636797:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541047936 00000100:00100000:2.0:1789607679.636842:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541048064 00000100:00100000:2.0:1789607679.636846:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541048064 00000100:00100000:2.0:1789607679.636888:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607679.636894:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876539541047936:12345-0@lo:400: 00000100:00100000:2.0:1789607679.636929:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876539541047936:12345-0@lo:400: Request processed in 35us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607679.636935:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607679.636947:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607679.636953:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876539541048064:12345-0@lo:400: 00000100:00100000:2.0:1789607679.636992:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876539541048064:12345-0@lo:400: Request processed in 39us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607679.636998:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789607679.637033:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee18f480 x1876539541048064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607679.637048:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876539541048064:0@lo:400: 00000100:00100000:2.0:1789607679.637058:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541047680:0@lo:400: 00010000:00080000:0.0:1789607679.637433:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee18e300 x1876539541047936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607679.637444:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876539541047936:0@lo:400: 00000100:00100000:0.0:1789607679.637455:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607679.637461:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541047808:0@lo:400: 00000100:00100000:0.0:1789607679.637489:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607679.637516:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541047808 00000100:00100000:0.0:1789607679.637520:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541047808 00000100:00100000:0.0:1789607679.637548:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607679.637554:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541047808:12345-0@lo:400: 00000100:00100000:0.0:1789607679.637589:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541047808:12345-0@lo:400: Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607679.637595:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789607679.637624:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee18c700 x1876539541047808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607679.637633:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541047808:0@lo:400: 00000100:00080000:0.0:1789607679.639657:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607679.639669:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607679.639723:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1e8f06a00 x1876539541047552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607679.639751:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541047552:0@lo:13: 00010000:00010000:3.0:1789607680.396648:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607681.425537:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607682.449111:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789607682.703899:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789607682.703907:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a1c8d84800 from 30 10000000:01000000:2.0:1789607682.703913:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789607682.703958:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607682.703970:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607682.703980:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607682.704004:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541048192:0@lo:101: 00000100:00100000:2.0:1789607682.704080:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607682.704131:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c9de3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607682.705882:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541048192 00000100:00100000:0.0:1789607682.705900:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541048192 00000100:00100000:0.0:1789607682.705960:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789607682.705971:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541048192:12345-0@lo:101: 00010000:00010000:0.0:1789607682.705986:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607682.706003:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103b400/0x33f091d001385f6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385f68 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.706028:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103b400/0x33f091d001385f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385f68 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.706039:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103b400/0x33f091d001385f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f68 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.706047:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b400, rc 0) 00000100:00100000:0.0:1789607682.706171:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541048192:12345-0@lo:101: Request processed in 201us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607682.706178:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789607682.712639:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f04380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541048192:0@lo:101: 00010000:00010000:1.0:1789607682.712671:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f6f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.712685:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385f6f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607682.712761:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541048320:0@lo:501: 00000100:00100000:1.0:1789607682.712819:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607682.712860:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac240 going to sleep for 11 seconds 00000100:00100000:1.0:1789607682.712887:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541048320 00000100:00100000:1.0:1789607682.712894:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541048320 00000100:00100000:1.0:1789607682.712933:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789607682.712942:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541048320:12345-0@lo:501: 00000100:00100000:1.0:1789607682.713301:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541048320:12345-0@lo:501: Request processed in 358us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607682.713308:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789607682.713348:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541048320:0@lo:501: 00000100:00100000:1.0:1789607682.713374:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541048448:0@lo:503: 00000100:00100000:1.0:1789607682.713411:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607682.713456:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac240 going to sleep for 11 seconds 00000100:00100000:1.0:1789607682.713468:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541048448 00000100:00100000:1.0:1789607682.713471:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541048448 00000100:00100000:1.0:1789607682.713490:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789607682.713495:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541048448:12345-0@lo:503: 00000100:00100000:1.0:1789607682.713769:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541048448:12345-0@lo:503: Request processed in 271us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607682.713776:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789607682.714016:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541048448:0@lo:503: 00000100:00100000:2.0:1789607682.721012:0:7970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7970:1876539541048576:0@lo:502: 00000100:00100000:2.0:1789607682.721106:0:7970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607682.721153:0:7970:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c9de3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607682.724289:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541048576 00000100:00100000:3.0:1789607682.724305:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541048576 00000100:00100000:3.0:1789607682.724378:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789607682.724389:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7970:x1876539541048576:12345-0@lo:502: 00000100:00100000:3.0:1789607682.724772:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7970:x1876539541048576:12345-0@lo:502: Request processed in 385us (3666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607682.724789:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789607682.729918:0:7970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7970:1876539541048576:0@lo:502: 00000100:00100000:2.0:1789607682.730004:0:7970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7970:1876539541048704:0@lo:502: 00000100:00100000:2.0:1789607682.730076:0:7970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607682.730120:0:7970:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c9de3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607682.730214:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541048704 00000100:00100000:0.0:1789607682.730223:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541048704 00000100:00100000:0.0:1789607682.730284:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789607682.730294:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7970:x1876539541048704:12345-0@lo:502: 00000100:00100000:0.0:1789607682.730554:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:7970:x1876539541048704:12345-0@lo:502: Request processed in 260us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607682.730562:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789607682.730756:0:7970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7970:1876539541048704:0@lo:502: 00000040:00080000:2.0:1789607682.730778:0:7970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789607682.731757:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789607682.731779:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789607682.731788:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f6f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.731809:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f6f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607682.731818:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789607682.731821:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789607682.731824:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789607682.731853:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.731860:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.731868:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607682.731885:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541048832:0@lo:101: 00000100:00100000:0.0:1789607682.731923:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607682.731964:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f50d8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789607682.732036:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541048832 00000100:00100000:1.0:1789607682.732043:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541048832 00000100:00100000:1.0:1789607682.732084:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789607682.732093:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541048832:12345-0@lo:101: 00010000:00010000:1.0:1789607682.732105:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607682.732119:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c167de00/0x33f091d001385f7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385f76 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.732142:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c167de00/0x33f091d001385f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385f76 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.732152:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c167de00/0x33f091d001385f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f76 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.732159:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c167de00, rc 0) 00000100:00100000:1.0:1789607682.732191:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541048832:12345-0@lo:101: Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607682.732197:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789607682.732278:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541048832:0@lo:101: 00010000:00010000:0.0:1789607682.732291:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.732300:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385f7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607682.732339:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541048960:0@lo:501: 00000100:00100000:0.0:1789607682.732364:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607682.732396:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f50d8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789607682.732457:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541048960 00000100:00100000:1.0:1789607682.732461:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541048960 00000100:00100000:1.0:1789607682.732481:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789607682.732486:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541048960:12345-0@lo:501: 00000100:00100000:1.0:1789607682.732697:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541048960:12345-0@lo:501: Request processed in 210us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607682.732703:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789607682.732795:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541048960:0@lo:501: 00000100:00100000:0.0:1789607682.732819:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541049088:0@lo:503: 00000100:00100000:0.0:1789607682.732854:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607682.732874:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f50d8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607682.734345:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541049088 00000100:00100000:2.0:1789607682.734356:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541049088 00000100:00100000:2.0:1789607682.734394:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789607682.734402:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541049088:12345-0@lo:503: 00000100:00100000:2.0:1789607682.734785:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541049088:12345-0@lo:503: Request processed in 383us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607682.734792:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789607682.737435:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541049088:0@lo:503: 00000100:00100000:1.0:1789607682.738096:0:7974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7974:1876539541049216:0@lo:502: 00000100:00100000:1.0:1789607682.738178:0:7974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607682.738219:0:7974:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20acc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607682.738277:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541049216 00000100:00100000:0.0:1789607682.738284:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541049216 00000100:00100000:0.0:1789607682.738330:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789607682.738340:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:7974:x1876539541049216:12345-0@lo:502: 00000100:00100000:0.0:1789607682.738629:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:7974:x1876539541049216:12345-0@lo:502: Request processed in 290us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607682.738638:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789607682.738737:0:7974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7974:1876539541049216:0@lo:502: 00000020:01000000:1.0:1789607682.738765:0:7974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607682.738774:0:7974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607682.738777:0:7974:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789607682.738782:0:7974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789607682.738784:0:7974:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789607682.738801:0:7974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7974:1876539541049344:0@lo:502: 00000100:00100000:1.0:1789607682.738833:0:7974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607682.738852:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541049344 00000100:00100000:1.0:1789607682.738855:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541049344 00000100:00100000:1.0:1789607682.738876:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789607682.738882:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:7974:x1876539541049344:12345-0@lo:502: 00000100:00100000:1.0:1789607682.738997:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:7974:x1876539541049344:12345-0@lo:502: Request processed in 115us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607682.739004:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789607682.739034:0:7974:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20acc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607682.739046:0:7974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7974:1876539541049344:0@lo:502: 00000020:01000000:1.0:1789607682.739062:0:7974:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607682.739065:0:7974:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607682.739067:0:7974:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789607682.739071:0:7974:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1789607682.739219:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789607682.739236:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789607682.739245:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.739256:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607682.739274:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789607682.739277:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a1c98a7800 from 30 10000000:01000000:0.0:1789607682.739280:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789607682.739303:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.739311:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.739326:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607682.739337:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541049472:0@lo:101: 00000100:00100000:0.0:1789607682.739362:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607682.739378:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f50d8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607682.739391:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541049472 00000100:00100000:0.0:1789607682.739394:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541049472 00000100:00100000:0.0:1789607682.739416:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789607682.739447:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541049472:12345-0@lo:101: 00010000:00010000:0.0:1789607682.739457:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607682.739470:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103a600/0x33f091d001385f8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385f84 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.739492:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103a600/0x33f091d001385f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385f84 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.739501:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103a600/0x33f091d001385f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f84 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.739509:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a600, rc 0) 00000100:00100000:0.0:1789607682.739538:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541049472:12345-0@lo:101: Request processed in 116us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607682.739543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789607682.739571:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541049472:0@lo:101: 00010000:00010000:0.0:1789607682.739583:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607682.739602:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385f8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607682.739641:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541049600:0@lo:501: 00000100:00100000:0.0:1789607682.739664:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607682.739690:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f50d8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607682.739701:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541049600 00000100:00100000:0.0:1789607682.739704:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541049600 00000100:00100000:0.0:1789607682.739724:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789607682.739729:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541049600:12345-0@lo:501: 00000100:00100000:0.0:1789607682.739936:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541049600:12345-0@lo:501: Request processed in 206us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607682.739944:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789607682.739976:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541049600:0@lo:501: 00000100:00100000:0.0:1789607682.740000:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541049728:0@lo:503: 00000100:00100000:0.0:1789607682.740033:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607682.740047:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f50d8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607682.740056:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541049728 00000100:00100000:0.0:1789607682.740060:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541049728 00000100:00100000:0.0:1789607682.740079:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789607682.740085:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541049728:12345-0@lo:503: 00000100:00100000:0.0:1789607682.740211:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541049728:12345-0@lo:503: Request processed in 126us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607682.740217:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789607682.740248:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541049728:0@lo:503: 00000100:00100000:3.0:1789607682.748538:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7975:1876539541049856:0@lo:502: 00000100:00100000:3.0:1789607682.748619:0:7975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607682.748659:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541049856 00000100:00100000:3.0:1789607682.748666:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541049856 00000100:00100000:3.0:1789607682.748783:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789607682.748793:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:7975:x1876539541049856:12345-0@lo:502: 00000100:00100000:3.0:1789607682.749832:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:7975:x1876539541049856:12345-0@lo:502: Request processed in 1023us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607682.749842:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789607682.750012:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8d9d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607682.750034:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7975:1876539541049856:0@lo:502: 00000100:00100000:3.0:1789607682.750610:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7975:1876539541049984:0@lo:502: 00000100:00100000:3.0:1789607682.750657:0:7975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607682.750842:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8d9d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607682.758434:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541049984 00000100:00100000:1.0:1789607682.758449:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541049984 00000100:00100000:1.0:1789607682.758522:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789607682.758532:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:7975:x1876539541049984:12345-0@lo:502: 00000100:00100000:1.0:1789607682.759482:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:7975:x1876539541049984:12345-0@lo:502: Request processed in 948us (8820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607682.759492:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789607682.759556:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7975:1876539541049984:0@lo:502: 00000040:00080000:2.0:1789607682.759592:0:7975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789607682.759747:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789607682.759769:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789607682.759779:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.759791:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607682.759800:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789607682.759803:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a1c98a7800 from 5 10000000:01000000:1.0:1789607682.759806:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789607682.760153:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.760163:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.760172:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607682.760190:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541050112:0@lo:101: 00000100:00100000:1.0:1789607682.760240:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607682.760288:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607682.760335:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541050112 00000100:00100000:3.0:1789607682.760350:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541050112 00000100:00100000:3.0:1789607682.760393:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789607682.760402:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541050112:12345-0@lo:101: 00010000:00010000:3.0:1789607682.760413:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607682.760449:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558ec00/0x33f091d001385f99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385f92 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607682.760473:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558ec00/0x33f091d001385f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385f92 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607682.760484:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558ec00/0x33f091d001385f99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f92 expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607682.760499:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558ec00, rc 0) 00000100:00100000:3.0:1789607682.760536:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541050112:12345-0@lo:101: Request processed in 135us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607682.760542:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789607682.760705:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541050112:0@lo:101: 00010000:00010000:1.0:1789607682.760718:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.760737:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607682.760780:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541050240:0@lo:256: 00000100:00100000:1.0:1789607682.760808:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607682.761052:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607682.761160:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541050240 00000100:00100000:3.0:1789607682.761165:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541050240 00000100:00100000:3.0:1789607682.761195:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789607682.761201:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541050240:12345-0@lo:256: 20000000:01000000:3.0:1789607682.761214:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789607682.761230:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789607682.761233:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789607682.761319:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541050240:12345-0@lo:256: Request processed in 117us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607682.761326:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789607682.761466:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541050240:0@lo:256: 10000000:01000000:1.0:1789607682.761508:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789607682.761514:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.761522:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607682.761530:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789607682.761532:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1789607682.761535:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789607682.761552:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.761560:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.761567:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607682.761578:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541050368:0@lo:101: 00000100:00100000:1.0:1789607682.761612:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607682.761624:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607682.761751:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541050368 00000100:00100000:3.0:1789607682.761756:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541050368 00000100:00100000:3.0:1789607682.761784:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789607682.761790:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541050368:12345-0@lo:101: 00010000:00010000:3.0:1789607682.761797:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607682.761805:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558fa00/0x33f091d001385fa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385fa0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607682.761981:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558fa00/0x33f091d001385fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385fa0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607682.761992:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558fa00/0x33f091d001385fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385fa0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607682.762008:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558fa00, rc 0) 00000100:00100000:3.0:1789607682.762086:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541050368:12345-0@lo:101: Request processed in 296us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607682.762093:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789607682.774541:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541050368:0@lo:101: 00010000:00010000:1.0:1789607682.774569:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385fa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.774583:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385fa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607682.774655:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541050496:0@lo:501: 00000100:00100000:1.0:1789607682.774783:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607682.774967:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac000 going to sleep for 11 seconds 00000100:00100000:2.0:1789607682.775307:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541050496 00000100:00100000:2.0:1789607682.775314:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541050496 00000100:00100000:2.0:1789607682.775370:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789607682.775380:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541050496:12345-0@lo:501: 00000100:00100000:2.0:1789607682.775669:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541050496:12345-0@lo:501: Request processed in 289us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607682.775694:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789607682.776808:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541050496:0@lo:501: 00000100:00100000:1.0:1789607682.776983:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541050624:0@lo:503: 00000100:00100000:1.0:1789607682.777032:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607682.777065:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac000 going to sleep for 11 seconds 00000100:00100000:2.0:1789607682.779536:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541050624 00000100:00100000:2.0:1789607682.779551:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541050624 00000100:00100000:2.0:1789607682.779608:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789607682.779618:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541050624:12345-0@lo:503: 00000100:00100000:2.0:1789607682.780009:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541050624:12345-0@lo:503: Request processed in 392us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607682.780017:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789607682.782799:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541050624:0@lo:503: 00000100:00100000:2.0:1789607682.785411:0:7980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7980:1876539541050752:0@lo:502: 00000100:00100000:2.0:1789607682.785516:0:7980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607682.785559:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541050752 00000100:00100000:2.0:1789607682.785566:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541050752 00000100:00100000:2.0:1789607682.785610:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789607682.785618:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:7980:x1876539541050752:12345-0@lo:502: 00000100:00100000:2.0:1789607682.785932:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:7980:x1876539541050752:12345-0@lo:502: Request processed in 313us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607682.785942:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789607682.785993:0:7980:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c9de3540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607682.786016:0:7980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7980:1876539541050752:0@lo:502: 00000020:01000000:2.0:1789607682.786043:0:7980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789607682.786052:0:7980:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789607682.786059:0:7980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607682.786062:0:7980:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789607682.786068:0:7980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789607682.786071:0:7980:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.103@tcp to nid 0x20000c0a8ca67 (192.168.202.103@tcp) 00000020:01000000:2.0:1789607682.786092:0:7980:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789607682.786101:0:7980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607682.786117:0:7980:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99a1f61a3380) 00000020:00000080:2.0:1789607682.786138:0:7980:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789607682.786143:0:7980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789607682.786209:0:7980:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789607682.786215:0:7980:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789607682.786223:0:7980:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d001385fb5 00010000:00080000:2.0:1789607682.786252:0:7980:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a1e4ce3800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:2.0:1789607682.786507:0:7980:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1789607682.786805:0:7980:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789607682.786817:0:7980:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789607682.787314:0:7980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607682.787558:0:7980:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607682.787609:0:7980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789607682.787662:0:7980:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789607682.794923:0:7981:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789607682.794930:0:7981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789607682.801101:0:7980:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789607682.802644:0:7980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789607682.802716:0:7980:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789607682.802742:0:7980:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33f091d001385fbc 00000100:00080000:2.0:1789607682.802754:0:7980:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607682.802766:0:7980:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a1e4ce3800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1789607682.802805:0:7980:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a1e8f05500 x1876539541050880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789607682.802838:0:7980:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789607682.802899:0:7980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607682.802904:0:7980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607682.802906:0:7980:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789607682.802909:0:7980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607682.802914:0:7980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607682.802915:0:7980:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789607682.802918:0:7980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789607682.802920:0:7980:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789607682.802955:0:7980:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7980:1876539541051008:0@lo:502: 00000100:00100000:2.0:1789607682.803028:0:7980:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607682.803065:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541051008 00000100:00100000:2.0:1789607682.803071:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541051008 00000100:00100000:2.0:1789607682.803106:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789607682.803115:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:7980:x1876539541051008:12345-0@lo:502: 00000100:00100000:0.0:1789607682.803717:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541050880:0@lo:8: 00000100:00100000:0.0:1789607682.803756:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607682.804548:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:7980:x1876539541051008:12345-0@lo:502: Request processed in 1430us (1516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607682.804557:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789607682.804607:0:7980:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c9de3540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607682.804626:0:7980:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:7980:1876539541051008:0@lo:502: 00000020:01000000:2.0:1789607682.804654:0:7980:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607682.804661:0:7980:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607682.804663:0:7980:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789607682.804667:0:7980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:1.0:1789607682.804990:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541050880 00000100:00100000:1.0:1789607682.805057:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541050880 00000100:00100000:1.0:1789607682.805085:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607682.805091:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1876539541050880:12345-0@lo:8: 00010000:00080000:1.0:1789607682.805112:0:6695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000100:00100000:2.0:1789607682.813327:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876539541051520:0@lo:400: 00000100:00100000:2.0:1789607682.813839:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607682.813890:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607682.813898:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541051136:0@lo:400: 00000100:00100000:2.0:1789607682.813921:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607682.813960:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541051520 00000100:00100000:2.0:1789607682.813970:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541051520 00000100:00100000:2.0:1789607682.814024:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541051136 00000100:00100000:2.0:1789607682.814028:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541051136 00000100:00100000:2.0:1789607682.814050:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789607682.814059:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876539541051520:12345-0@lo:400: 00000100:00100000:2.0:1789607682.814111:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876539541051520:12345-0@lo:400: Request processed in 52us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607682.814133:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789607682.814152:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789607682.814158:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541051136:12345-0@lo:400: 00000100:00100000:2.0:1789607682.814187:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541051136:12345-0@lo:400: Request processed in 29us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607682.814192:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789607682.815822:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789607682.815881:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61c9180 x1876539541051136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607682.815898:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541051136:0@lo:400: 00010000:00080000:2.0:1789607682.815911:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61c8380 x1876539541051520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607682.815920:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876539541051520:0@lo:400: 00000020:00000080:1.0:1789607682.815941:0:6695:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33f091d001385fc3 00002000:00100000:1.0:1789607682.815959:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99a1f5009000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789607682.815985:0:6695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789607682.815989:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1789607682.816050:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789607682.816075:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789607682.816085:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385fa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607682.816096:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385fa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607682.816106:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789607682.816109:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99a1c6588000 from 1 10000000:01000000:2.0:1789607682.816112:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789607682.816146:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607682.816165:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607682.816177:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607682.816196:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541051648:0@lo:101: 00002000:00100000:1.0:1789607682.816235:0:6695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789607682.816604:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789607682.816637:0:6695:0:(import.c:65:import_set_state_nolock()) ffff99a1f500d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607682.816768:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876539541050880:12345-0@lo:8: Request processed in 11675us (13009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607682.816777:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607682.816808:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876539541051264:0@lo:400: 00000100:00100000:1.0:1789607682.816856:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607682.816894:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607682.816901:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541051392:0@lo:400: 00000100:00100000:1.0:1789607682.816922:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607682.816951:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541051392 00000100:00100000:1.0:1789607682.816957:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541051392 00000100:00100000:1.0:1789607682.816997:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607682.817005:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541051392:12345-0@lo:400: 00000100:00100000:1.0:1789607682.817038:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541051392:12345-0@lo:400: Request processed in 34us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607682.817044:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789607682.817075:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61c9500 x1876539541051392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607682.817085:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541051392:0@lo:400: 00000100:00080000:1.0:1789607682.817099:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607682.817108:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541051264 00000100:00100000:1.0:1789607682.817111:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541051264 00000100:00100000:1.0:1789607682.817136:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607682.817149:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876539541051264:12345-0@lo:400: 00000100:00100000:1.0:1789607682.817178:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876539541051264:12345-0@lo:400: Request processed in 31us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607682.817183:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789607682.817203:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61cb480 x1876539541051264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607682.817212:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876539541051264:0@lo:400: 00000100:00080000:1.0:1789607682.817224:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607682.817824:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607682.817851:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c9de3540 going to sleep for 11 seconds 00000100:00100000:1.0:1789607682.818169:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541051648 00000100:00100000:1.0:1789607682.818176:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541051648 00000100:00100000:1.0:1789607682.818215:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789607682.818227:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541051648:12345-0@lo:101: 00010000:00010000:1.0:1789607682.818241:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607682.818257:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c167c800/0x33f091d001385fd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001385fca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.818295:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c167c800/0x33f091d001385fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001385fca expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.818306:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c167c800/0x33f091d001385fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385fca expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607682.818315:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c167c800, rc 0) 00000100:00100000:1.0:1789607682.818352:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541051648:12345-0@lo:101: Request processed in 130us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607682.818358:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789607682.819307:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541051648:0@lo:101: 00010000:00010000:2.0:1789607682.819327:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385fd1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607682.819351:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385fd1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607682.819419:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541051776:0@lo:501: 00000100:00100000:2.0:1789607682.819469:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607682.819494:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541051776 00000100:00100000:2.0:1789607682.819498:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541051776 00000100:00100000:2.0:1789607682.819520:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789607682.819526:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541051776:12345-0@lo:501: 00000100:00100000:2.0:1789607682.819749:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541051776:12345-0@lo:501: Request processed in 222us (278us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789607682.819757:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789607682.819796:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c9de3540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607682.819815:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541051776:0@lo:501: 10000000:01000000:2.0:1789607682.819840:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789607682.819847:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385fd1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607682.819855:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385fd1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789607682.824151:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1e8f05500 x1876539541050880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607692 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607682.824168:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607682.824178:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789607682.824189:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789607682.824195:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789607682.824198:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1e4ce3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789607682.824261:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789607682.824277:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541050880:0@lo:8: 00000004:00080000:3.0:1789607682.824316:0:7981:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789607682.824482:0:7981:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 216669058520ns, next at 0ns, rc = 0 00000004:00080000:3.0:1789607682.931544:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:02000400:1.0:1789607682.983036:0:7997:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:00080000:2.0:1789607683.020585:0:7982:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789607683.020619:0:7982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7982:1876539541052032:0@lo:7: 00000100:00100000:2.0:1789607683.020689:0:7982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607683.020745:0:7982:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e4fba600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607683.020762:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607683.020774:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541051904:0@lo:13: 00000100:00100000:2.0:1789607683.020797:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607683.020908:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541051904 00000100:00100000:2.0:1789607683.020916:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541051904 00000100:00100000:2.0:1789607683.020975:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607683.020984:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541051904:12345-0@lo:13: 00002000:00000024:2.0:1789607683.021015:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789607683.021059:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541051904:12345-0@lo:13: Request processed in 77us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607683.021066:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789607683.021105:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1e8f05f80 x1876539541051904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607699 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607683.021122:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541051904:0@lo:13: 00000100:00100000:1.0:1789607683.022118:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541052032 00000100:00100000:1.0:1789607683.022131:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541052032 00000100:00100000:1.0:1789607683.023399:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607683.023411:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7982:x1876539541052032:12345-0@lo:7: 00000100:00080000:0.0:1789607683.028558:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1789607683.034522:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789607683.034531:0:6694:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789607683.035508:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7982:x1876539541052032:12345-0@lo:7: Request processed in 12093us (14812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607683.035520:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789607683.035712:0:7982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1e8f05880 x1876539541052032/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789607699 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607683.035730:0:7982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7982:1876539541052032:0@lo:7: 00000004:00080000:3.0:1789607683.035743:0:7982:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789607683.035783:0:7982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee291c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7982:1876539541052160:0@lo:5: 00000100:00100000:3.0:1789607683.035843:0:7982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607683.035881:0:7982:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8d9d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789607683.041398:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541052160 00000100:00100000:1.0:1789607683.041413:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541052160 00000100:00100000:1.0:1789607683.041501:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607683.041510:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7982:x1876539541052160:12345-0@lo:5: 00002000:00080000:1.0:1789607683.041543:0:6695:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789607683.041546:0:6695:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789607683.041899:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7982:x1876539541052160:12345-0@lo:5: Request processed in 389us (6055us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789607683.041907:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789607683.042023:0:7982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee291c00 x1876539541052160/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607699 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607683.042041:0:7982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee291c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7982:1876539541052160:0@lo:5: 00000004:00080000:0.0:1789607683.042054:0:7982:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789607683.042090:0:7982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7982:1876539541052288:0@lo:700: 00000100:00100000:0.0:1789607683.042126:0:7982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607683.042158:0:7982:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c2e7e780 going to sleep for 11 seconds 00000100:00100000:2.0:1789607683.043572:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541052288 00000100:00100000:2.0:1789607683.043595:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541052288 00000100:00100000:2.0:1789607683.043680:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607683.043689:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7982:x1876539541052288:12345-0@lo:700: 00000100:00100000:2.0:1789607683.043730:0:6701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6701:1876539541052416:0@lo:700: 00000100:00100000:2.0:1789607683.043771:0:6701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607683.043798:0:6701:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e4fba480 going to sleep for 11 seconds 00000100:00100000:0.0:1789607683.044396:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541052416 00000100:00100000:0.0:1789607683.044402:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541052416 00000100:00100000:0.0:1789607683.044464:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607683.044473:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6701:x1876539541052416:12345-0@lo:700: 40000000:02000000:1.0:1789607683.128829:0:5854:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1789607683.134583:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6701:x1876539541052416:12345-0@lo:700: Request processed in 90105us (90804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607683.134602:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789607683.134833:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1e8f05f80 x1876539541052416/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789607699 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607683.134849:0:6701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6701:1876539541052416:0@lo:700: 40000000:02000000:2.0:1789607683.134871:0:6701:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1789607683.278226:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789607683.278248:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789607683.283102:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7982:x1876539541052288:12345-0@lo:700: Request processed in 239404us (240965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607683.283117:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789607683.283189:0:7982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee18ed80 x1876539541052288/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789607699 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607683.283213:0:7982:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789607683.283229:0:7982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7982:1876539541052288:0@lo:700: 00000004:02000040:1.0:1789607683.328617:0:7982:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1789607683.331891:0:7982:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7982:1876539541052544:0@lo:5: 00000100:00100000:1.0:1789607683.331964:0:7982:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607683.332023:0:7982:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac180 going to sleep for 11 seconds 00000100:00100000:0.0:1789607683.332394:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541052544 00000100:00100000:0.0:1789607683.332402:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541052544 00000100:00100000:0.0:1789607683.332480:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607683.332490:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7982:x1876539541052544:12345-0@lo:5: 00002000:00080000:0.0:1789607683.344823:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789607683.344845:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1789607683.355157:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7982:x1876539541052544:12345-0@lo:5: Request processed in 22656us (23181us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789607683.355171:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789607683.363270:0:7982:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61cb480 x1876539541052544/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789607699 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607683.363308:0:7982:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7982:1876539541052544:0@lo:5: 00000004:00080000:1.0:1789607683.363325:0:7982:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1789607683.471601:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607684.494257:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607684.749313:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541052672:0@lo:13: 00000100:00100000:3.0:1789607684.749400:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607684.749547:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541052672 00000100:00100000:2.0:1789607684.749556:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541052672 00000100:00100000:2.0:1789607684.749625:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607684.749636:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541052672:12345-0@lo:13: 00002000:00000024:2.0:1789607684.749674:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607684.749733:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541052672:12345-0@lo:13: Request processed in 99us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607684.749741:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789607684.749792:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1e8f05f80 x1876539541052672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607684.749811:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541052672:0@lo:13: 00000100:00080000:3.0:1789607684.749869:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789607685.517919:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607686.542453:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607687.566620:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607687.819648:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541052800:0@lo:400: 00000100:00100000:1.0:1789607687.819706:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541053056:0@lo:400: 00000100:00100000:1.0:1789607687.821180:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607687.821278:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789607687.821290:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541052928:0@lo:400: 00000100:00100000:1.0:1789607687.821320:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607687.821340:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541053440:0@lo:400: 00000100:00100000:1.0:1789607687.821365:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607687.827349:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607687.827492:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541053312:0@lo:400: 00000100:00100000:0.0:1789607687.827587:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607687.827610:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607687.827617:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541053184:0@lo:400: 00000100:00100000:0.0:1789607687.827650:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607687.827693:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541053440 00000100:00100000:0.0:1789607687.827704:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541053440 00000100:00100000:0.0:1789607687.827773:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541053184 00000100:00100000:0.0:1789607687.827777:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541053184 00000100:00100000:0.0:1789607687.827800:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607687.827811:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541053440:12345-0@lo:400: 00000100:00100000:0.0:1789607687.827875:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541053440:12345-0@lo:400: Request processed in 66us (6508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607687.827883:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607687.827904:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789607687.827910:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541053184:12345-0@lo:400: 00000100:00100000:0.0:1789607687.827940:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541053184:12345-0@lo:400: Request processed in 31us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607687.827946:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789607687.827963:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607687.827967:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789607687.827996:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61c9180 x1876539541053184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607687.828014:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541053184:0@lo:400: 00000100:00100000:1.0:1789607687.833332:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541052800 00000100:00100000:1.0:1789607687.833353:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541052800 00000100:00100000:1.0:1789607687.833443:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789607687.833455:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541052800:12345-0@lo:400: 00000100:00100000:1.0:1789607687.833582:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541052800:12345-0@lo:400: Request processed in 129us (6245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607687.833591:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789607687.833638:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541053056 00000100:00100000:1.0:1789607687.833643:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541053056 00000100:00100000:1.0:1789607687.833692:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541052928 00000100:00100000:1.0:1789607687.833697:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541052928 00000100:00100000:1.0:1789607687.833714:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541053312 00000100:00100000:1.0:1789607687.833717:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541053312 00000100:00100000:1.0:1789607687.833733:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789607687.833741:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541053056:12345-0@lo:400: 00000100:00100000:1.0:1789607687.833794:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541053056:12345-0@lo:400: Request processed in 54us (12622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607687.833801:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789607687.833817:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789607687.833824:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541052928:12345-0@lo:400: 00000100:00100000:1.0:1789607687.833856:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541052928:12345-0@lo:400: Request processed in 35us (12535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607687.833862:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789607687.833876:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607687.833882:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541053312:12345-0@lo:400: 00000100:00100000:1.0:1789607687.833911:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541053312:12345-0@lo:400: Request processed in 31us (6324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607687.833917:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789607687.833948:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789607687.834010:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61c8700 x1876539541052928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607687.834030:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541052928:0@lo:400: 00010000:00080000:0.0:1789607687.834059:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c8d98000 x1876539541053440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607687.834070:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541053440:0@lo:400: 00010000:00080000:0.0:1789607687.834082:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61c8380 x1876539541053056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607687.834091:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541053056:0@lo:400: 00010000:00080000:0.0:1789607687.834135:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61caa00 x1876539541053312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607687.834143:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541053312:0@lo:400: 00000100:00100000:0.0:1789607687.834153:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541052800:0@lo:400: 00000100:00100000:0.0:1789607688.333852:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541053568:0@lo:13: 00000100:00100000:0.0:1789607688.333956:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607688.334051:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541053568 00000100:00100000:0.0:1789607688.334061:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541053568 00000100:00100000:0.0:1789607688.334115:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607688.334126:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541053568:12345-0@lo:13: 00002000:00000024:0.0:1789607688.334173:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607688.334238:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541053568:12345-0@lo:13: Request processed in 114us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607688.334246:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789607688.334294:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee18e680 x1876539541053568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607704 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607688.334317:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541053568:0@lo:13: 00000001:00080000:3.0:1789607688.452889:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1789607688.592849:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607689.611699:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607689.867731:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541053696:0@lo:13: 00000100:00100000:1.0:1789607689.867833:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607689.868047:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541053696 00000100:00100000:2.0:1789607689.868058:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541053696 00000100:00100000:2.0:1789607689.868134:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607689.868157:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541053696:12345-0@lo:13: 00002000:00000024:2.0:1789607689.868212:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607689.868280:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541053696:12345-0@lo:13: Request processed in 126us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607689.868288:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789607689.868566:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1e8f05f80 x1876539541053696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607689.868590:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541053696:0@lo:13: 00000100:00080000:1.0:1789607689.868664:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789607690.635940:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607690.745700:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607690.745816:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520057728 00000100:00100000:2.0:1789607690.745831:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520057728 00000100:00100000:2.0:1789607690.745997:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:2.0:1789607690.746005:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2372:x1876539520057728:12345-192.168.202.3@tcp:250: 00010000:00080000:2.0:1789607690.746038:0:5841:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from dbac41d3-98d0-4271-a0dc-a31a8d191718@192.168.202.3@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:2.0:1789607690.746072:0:5841:0:(genops.c:1384:class_connect()) connect: client dbac41d3-98d0-4271-a0dc-a31a8d191718, cookie 0x33f091d001385fd8 00000100:00080000:2.0:1789607690.746232:0:5841:0:(import.c:65:import_set_state_nolock()) ffff99a0c1ce5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607690.746387:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+5:2372:x1876539520057728:12345-192.168.202.3@tcp:250: Request processed in 380us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607690.746511:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:1.0:1789607690.748740:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607690.748945:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520057600 00000100:00100000:2.0:1789607690.748956:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520057600 00000100:00100000:2.0:1789607690.749014:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:2.0:1789607690.749025:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+5:5602:x1876539520057600:12345-192.168.202.3@tcp:101: 00010000:00010000:2.0:1789607690.749046:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607690.749069:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d8d7e600/0x33f091d001385fdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9452 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607690.749103:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d8d7e600/0x33f091d001385fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9452 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607690.749114:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d8d7e600/0x33f091d001385fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9452 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607690.749123:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d8d7e600, rc 0) 00000100:00100000:2.0:1789607690.749222:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+6:5602:x1876539520057600:12345-192.168.202.3@tcp:101: Request processed in 199us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607690.749229:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:1.0:1789607690.750891:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607690.750976:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520057856 00000100:00100000:2.0:1789607690.750985:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520057856 00000100:00100000:2.0:1789607690.751026:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:2.0:1789607690.751033:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+6:5602:x1876539520057856:12345-192.168.202.3@tcp:501: 00000100:00100000:2.0:1789607690.751789:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+6:5602:x1876539520057856:12345-192.168.202.3@tcp:501: Request processed in 752us (906us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789607690.751798:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:3.0:1789607690.754608:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607690.755001:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520057984 00000100:00100000:2.0:1789607690.755014:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520057984 00000100:00100000:2.0:1789607690.755069:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 116 00000100:00100000:2.0:1789607690.755077:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+6:5602:x1876539520057984:12345-192.168.202.3@tcp:101: 00010000:00010000:2.0:1789607690.755096:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607690.755118:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d8d7f400/0x33f091d001385fe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9459 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607690.755155:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d8d7f400/0x33f091d001385fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9459 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607690.755170:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d8d7f400/0x33f091d001385fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9459 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607690.755182:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d8d7f400, rc 0) 00000100:00100000:2.0:1789607690.755274:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+7:5602:x1876539520057984:12345-192.168.202.3@tcp:101: Request processed in 197us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607690.755279:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 116 00000100:00100000:1.0:1789607690.757518:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607690.757617:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520058112 00000100:00100000:2.0:1789607690.757627:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520058112 00000100:00100000:2.0:1789607690.757684:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 117 00000100:00100000:2.0:1789607690.757692:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+7:5602:x1876539520058112:12345-192.168.202.3@tcp:501: 00000100:00100000:2.0:1789607690.758056:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:5602:x1876539520058112:12345-192.168.202.3@tcp:501: Request processed in 364us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607690.758063:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 117 00000100:00100000:0.0:1789607690.759934:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607690.760046:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520058240 00000100:00100000:2.0:1789607690.760054:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520058240 00000100:00100000:2.0:1789607690.760126:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:2.0:1789607690.760145:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:5602:x1876539520058240:12345-192.168.202.3@tcp:503: 00000100:00100000:2.0:1789607690.760894:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:5602:x1876539520058240:12345-192.168.202.3@tcp:503: Request processed in 744us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607690.760903:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:3.0:1789607690.762723:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607690.763008:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520058368 00000100:00100000:1.0:1789607690.763021:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520058368 00000100:00100000:1.0:1789607690.763377:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 119 00000100:00100000:1.0:1789607690.763388:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:5621:x1876539520058368:12345-192.168.202.3@tcp:502: 00000100:00100000:1.0:1789607690.764397:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:5621:x1876539520058368:12345-192.168.202.3@tcp:502: Request processed in 1004us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607690.764419:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 119 00000100:00100000:1.0:1789607690.783617:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607690.785789:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520058496 00000100:00100000:2.0:1789607690.785810:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520058496 00000100:00100000:2.0:1789607690.791208:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00100000:2.0:1789607690.791245:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:5621:x1876539520058496:12345-192.168.202.3@tcp:502: 00000100:00100000:2.0:1789607690.792971:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:5621:x1876539520058496:12345-192.168.202.3@tcp:502: Request processed in 1721us (9346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607690.792988:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00100000:0.0:1789607690.804147:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607690.804272:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520058624 00000100:00100000:1.0:1789607690.804286:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520058624 00000100:00100000:1.0:1789607690.804359:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 121 00000100:00100000:1.0:1789607690.804372:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:5602:x1876539520058624:12345-192.168.202.3@tcp:101: 00010000:00010000:1.0:1789607690.804395:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607690.804473:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c167ce00/0x33f091d001385fed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9483 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607690.804522:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c167ce00/0x33f091d001385fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9483 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607690.804537:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c167ce00/0x33f091d001385fed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9483 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607690.804549:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c167ce00, rc 0) 00000100:00100000:1.0:1789607690.805050:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:5602:x1876539520058624:12345-192.168.202.3@tcp:101: Request processed in 680us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607690.805057:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 121 00000100:00100000:2.0:1789607690.816986:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607690.817174:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520058752 00000100:00100000:1.0:1789607690.817196:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520058752 00000100:00100000:1.0:1789607690.817267:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 122 00000100:00100000:1.0:1789607690.817281:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:5602:x1876539520058752:12345-192.168.202.3@tcp:256: 20000000:01000000:1.0:1789607690.817319:0:5842:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789607690.817356:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789607690.817361:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789607690.817372:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789607690.817375:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789607690.819859:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:5602:x1876539520058752:12345-192.168.202.3@tcp:256: Request processed in 2566us (2886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607690.819891:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 122 00000100:00100000:0.0:1789607690.823892:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607690.824017:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520058880 00000100:00100000:2.0:1789607690.824032:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520058880 00000100:00100000:2.0:1789607690.824105:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 123 00000100:00100000:2.0:1789607690.824117:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:5602:x1876539520058880:12345-192.168.202.3@tcp:101: 00010000:00010000:2.0:1789607690.824149:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607690.824178:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c1510800/0x33f091d001385ff4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b948a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607690.824224:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c1510800/0x33f091d001385ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b948a expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607690.824237:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c1510800/0x33f091d001385ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b948a expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607690.824248:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1510800, rc 0) 00000100:00100000:2.0:1789607690.824341:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5602:x1876539520058880:12345-192.168.202.3@tcp:101: Request processed in 225us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607690.824349:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 123 00000100:00100000:3.0:1789607690.827834:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607690.828274:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520059008 00000100:00100000:2.0:1789607690.828288:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520059008 00000100:00100000:2.0:1789607690.828412:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 124 00000100:00100000:2.0:1789607690.828453:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5602:x1876539520059008:12345-192.168.202.3@tcp:501: 00000100:00100000:2.0:1789607690.828878:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5602:x1876539520059008:12345-192.168.202.3@tcp:501: Request processed in 418us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607690.828887:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 124 00000100:00100000:1.0:1789607690.832261:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607690.834703:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520059136 00000100:00100000:0.0:1789607690.834724:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520059136 00000100:00100000:0.0:1789607690.834802:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 125 00000100:00100000:0.0:1789607690.834815:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5602:x1876539520059136:12345-192.168.202.3@tcp:503: 00000100:00100000:0.0:1789607690.836306:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5602:x1876539520059136:12345-192.168.202.3@tcp:503: Request processed in 1483us (4049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607690.836320:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 125 00000100:00100000:1.0:1789607690.849332:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607690.851792:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520059264 00000100:00100000:2.0:1789607690.851813:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520059264 00000100:00100000:2.0:1789607690.851961:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 126 00000100:00100000:2.0:1789607690.851975:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5625:x1876539520059264:12345-192.168.202.3@tcp:502: 00000100:00100000:2.0:1789607690.852986:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5625:x1876539520059264:12345-192.168.202.3@tcp:502: Request processed in 1007us (3666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607690.852998:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 126 00000100:00100000:2.0:1789607690.856269:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607690.856386:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520059392 00000100:00100000:1.0:1789607690.856626:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520059392 00000100:00100000:1.0:1789607690.856789:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 127 00000100:00100000:1.0:1789607690.856802:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5625:x1876539520059392:12345-192.168.202.3@tcp:502: 00000100:00100000:1.0:1789607690.857284:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5625:x1876539520059392:12345-192.168.202.3@tcp:502: Request processed in 483us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607690.857294:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 127 00000100:00100000:2.0:1789607690.862590:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607690.862736:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520059520 00000100:00100000:3.0:1789607690.862752:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520059520 00000100:00100000:3.0:1789607690.862815:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1789607690.862825:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2372:x1876539520059520:12345-192.168.202.3@tcp:38: 00010000:00080000:3.0:1789607690.862865:0:6790:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp t0 exp 0000000000000000 cur 224 last 0 00000020:00000080:3.0:1789607690.862944:0:6790:0:(genops.c:1384:class_connect()) connect: client d0d9aceb-01dc-4deb-add2-cd492a0443a6, cookie 0x33f091d001385ffb 00000004:00100000:3.0:1789607690.862998:0:6790:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789607690.863006:0:6790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1789607690.910984:0:6790:0:(import.c:65:import_set_state_nolock()) ffff99a1fb249000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607690.911104:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2372:x1876539520059520:12345-192.168.202.3@tcp:38: Request processed in 48276us (48527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607690.911118:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00010000:00010000:0.0:1789607691.659948:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607691.928188:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607691.928251:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607691.929037:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520059648 00000100:00100000:3.0:1789607691.929052:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520059648 00000100:00100000:3.0:1789607691.929221:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520059776 00000100:00100000:3.0:1789607691.929226:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520059776 00000100:00100000:3.0:1789607691.929264:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:3.0:1789607691.929278:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:0:x1876539520059648:12345-192.168.202.3@tcp:41: 00000004:00000024:3.0:1789607691.929345:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607691.931096:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:1.0:1789607691.931138:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:5602:x1876539520059776:12345-192.168.202.3@tcp:41: 00000004:00000024:1.0:1789607691.931187:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607691.936746:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:5602:x1876539520059776:12345-192.168.202.3@tcp:41: Request processed in 5618us (8478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607691.936764:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:3.0:1789607691.936886:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:0:x1876539520059648:12345-192.168.202.3@tcp:41: Request processed in 7601us (8713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607691.936901:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00080000:0.0:1789607691.941110:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607691.941686:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607691.941931:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520059904 00000100:00100000:3.0:1789607691.941942:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520059904 00000100:00100000:3.0:1789607691.942009:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1789607691.942022:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:5602:x1876539520059904:12345-192.168.202.3@tcp:40: 00000100:00100000:3.0:1789607691.942133:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:5602:x1876539520059904:12345-192.168.202.3@tcp:40: Request processed in 113us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607691.942142:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:2.0:1789607691.959873:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607691.960006:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607691.960046:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607691.960076:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607691.960108:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520060032 00000100:00100000:2.0:1789607691.960132:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520060032 00000100:00100000:2.0:1789607691.960170:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520060160 00000100:00100000:2.0:1789607691.960174:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520060160 00000100:00100000:2.0:1789607691.960199:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:2.0:1789607691.960208:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2372:x1876539520060032:12345-192.168.202.3@tcp:8: 00010000:00080000:2.0:1789607691.960244:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:2.0:1789607691.960282:0:6692:0:(genops.c:1384:class_connect()) connect: client d0d9aceb-01dc-4deb-add2-cd492a0443a6, cookie 0x33f091d001386002 00002000:00100000:2.0:1789607691.960295:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d0d9aceb-01dc-4deb-add2-cd492a0443a6/ffff99a0c1ce6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789607691.960325:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789607691.962280:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789607691.962320:0:6692:0:(import.c:65:import_set_state_nolock()) ffff99a0c1ce1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607691.963585:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520060416 00000100:00100000:1.0:1789607691.963596:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520060416 00000100:00100000:1.0:1789607691.963652:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 128 00000100:00100000:1.0:1789607691.963669:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2374:x1876539520060416:12345-192.168.202.3@tcp:400: 00000100:00100000:2.0:1789607691.963816:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2372:x1876539520060032:12345-192.168.202.3@tcp:8: Request processed in 3605us (3766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607691.963826:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:2.0:1789607691.963844:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:2.0:1789607691.963849:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2372:x1876539520060160:12345-192.168.202.3@tcp:8: 00010000:00080000:2.0:1789607691.963871:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp t0 exp 0000000000000000 cur 225 last 0 00000020:00000080:2.0:1789607691.963901:0:6692:0:(genops.c:1384:class_connect()) connect: client d0d9aceb-01dc-4deb-add2-cd492a0443a6, cookie 0x33f091d001386009 00002000:00100000:2.0:1789607691.963921:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d0d9aceb-01dc-4deb-add2-cd492a0443a6/ffff99a0c1ce5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789607691.963941:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789607691.964230:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789607691.964254:0:6692:0:(import.c:65:import_set_state_nolock()) ffff99a0c1ce7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607691.965248:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520060288 00000100:00100000:3.0:1789607691.965256:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520060288 00000100:00100000:3.0:1789607691.965299:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:3.0:1789607691.965308:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:5602:x1876539520060288:12345-192.168.202.3@tcp:33: 00000100:00100000:1.0:1789607691.969089:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2374:x1876539520060416:12345-192.168.202.3@tcp:400: Request processed in 5415us (9069us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607691.969115:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 128 00000100:00100000:2.0:1789607691.978737:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2372:x1876539520060160:12345-192.168.202.3@tcp:8: Request processed in 14817us (18590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607691.978753:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000004:00080000:3.0:1789607691.991185:0:5850:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25800us 00000004:00200000:2.0:1789607692.001203:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789607692.001310:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:5602:x1876539520060288:12345-192.168.202.3@tcp:33: Request processed in 35994us (41439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607692.001326:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:2.0:1789607692.314799:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607692.315336:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520060544 00000100:00100000:1.0:1789607692.315348:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520060544 00000100:00100000:1.0:1789607692.315562:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1789607692.315574:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:5642:x1876539520060544:12345-192.168.202.3@tcp:101: 00010000:00010000:1.0:1789607692.315596:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607692.315674:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c167d200/0x33f091d001386010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b94b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607692.315945:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c167da00/0x33f091d001386017 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607692.315962:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c167da00/0x33f091d001386017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607692.315979:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c167da00/0x33f091d001386017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607692.316015:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789607692.316019:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607692.316034:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c167da00/0x33f091d001386017 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607692.316061:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c167d200/0x33f091d001386010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94b4 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607692.316081:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c167da00/0x33f091d001386017 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94b4 expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607692.316110:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7db00) 00010000:00010000:1.0:1789607692.316113:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607692.316118:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c167da00, rc 0) 00000100:00100000:1.0:1789607692.316200:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:5642:x1876539520060544:12345-192.168.202.3@tcp:101: Request processed in 629us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607692.316209:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000001:00100000:3.0:1789607692.526830:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d0d9aceb-01dc-4deb-add2-cd492a0443a6 00010000:00010000:2.0:1789607692.684677:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607692.939706:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541054208:0@lo:400: 00000100:00100000:2.0:1789607692.939785:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607692.939854:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789607692.939861:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541053824:0@lo:400: 00000100:00100000:2.0:1789607692.939890:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607692.939915:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541054336:0@lo:400: 00000100:00100000:2.0:1789607692.939938:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607692.939968:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541054336 00000100:00100000:2.0:1789607692.939976:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541054336 00000100:00100000:2.0:1789607692.940040:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789607692.940046:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607692.940049:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541054336:12345-0@lo:400: 00000100:00100000:2.0:1789607692.940107:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541054336:12345-0@lo:400: Request processed in 59us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607692.940114:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607692.940164:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541054336:0@lo:400: 00000100:00100000:1.0:1789607692.940209:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541054208 00000100:00100000:0.0:1789607692.940210:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541053952:0@lo:400: 00000100:00100000:1.0:1789607692.940212:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541054208 00000100:00100000:0.0:1789607692.940240:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607692.940257:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607692.940260:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541054464:0@lo:400: 00000100:00100000:1.0:1789607692.940264:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541054208:12345-0@lo:400: 00000100:00100000:0.0:1789607692.940281:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607692.940297:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541054208:12345-0@lo:400: Request processed in 34us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607692.940297:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607692.940302:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541054080:0@lo:400: 00000100:00100000:1.0:1789607692.940303:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607692.940314:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541054464 00000100:00100000:1.0:1789607692.940317:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541054464 00000100:00100000:0.0:1789607692.940321:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607692.940334:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789607692.940339:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541054464:12345-0@lo:400: 00000100:00100000:0.0:1789607692.940345:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541053952 00000100:00100000:0.0:1789607692.940348:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541053952 00000100:00100000:0.0:1789607692.940369:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541054080 00000100:00100000:1.0:1789607692.940370:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541054464:12345-0@lo:400: Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607692.940371:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541054080 00000100:00100000:1.0:1789607692.940376:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607692.940389:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789607692.940396:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541053952:12345-0@lo:400: 00010000:00080000:1.0:1789607692.940404:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee291180 x1876539541054208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607692.940415:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541054208:0@lo:400: 00000100:00100000:0.0:1789607692.940442:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541053952:12345-0@lo:400: Request processed in 47us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607692.940452:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789607692.940465:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789607692.940471:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541054080:12345-0@lo:400: 00000100:00100000:1.0:1789607692.940488:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541053952:0@lo:400: 00000100:00100000:0.0:1789607692.940497:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541054080:12345-0@lo:400: Request processed in 27us (176us total) trans 0 rc 0/0 00010000:00080000:1.0:1789607692.940498:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee293480 x1876539541054464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607692.940503:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607692.940506:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789607692.940516:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541054464:0@lo:400: 00000100:00100000:1.0:1789607692.940530:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541054080:0@lo:400: 00000100:00080000:2.0:1789607692.940595:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607692.940599:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607692.940601:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607692.940872:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541053824 00000100:00100000:3.0:1789607692.940878:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541053824 00000100:00100000:3.0:1789607692.940911:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789607692.940918:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541053824:12345-0@lo:400: 00000100:00100000:3.0:1789607692.940963:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541053824:12345-0@lo:400: Request processed in 46us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607692.940970:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789607692.941713:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee293b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541053824:0@lo:400: 00000100:00100000:2.0:1789607693.454473:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607693.454500:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541054592:0@lo:13: 00000100:00100000:2.0:1789607693.454570:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607693.454696:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541054592 00000100:00100000:0.0:1789607693.454705:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541054592 00000100:00100000:0.0:1789607693.454756:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789607693.454775:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541054592:12345-0@lo:13: 00002000:00000024:0.0:1789607693.454807:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607693.454856:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541054592:12345-0@lo:13: Request processed in 83us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607693.454862:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789607693.454963:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61c8380 x1876539541054592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607709 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607693.454981:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541054592:0@lo:13: 00010000:00010000:0.0:1789607693.707793:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607694.383136:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607694.383489:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520060672 00000100:00100000:2.0:1789607694.383500:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520060672 00000100:00100000:2.0:1789607694.383577:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:2.0:1789607694.383588:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:5694:x1876539520060672:12345-192.168.202.3@tcp:41: 00000004:00000024:2.0:1789607694.383634:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607694.383714:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:5694:x1876539520060672:12345-192.168.202.3@tcp:41: Request processed in 127us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607694.383722:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00080000:1.0:1789607694.384340:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607694.388182:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607694.388469:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520060800 00000100:00100000:2.0:1789607694.388478:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520060800 00000100:00100000:2.0:1789607694.388555:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:2.0:1789607694.388565:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:5694:x1876539520060800:12345-192.168.202.3@tcp:13: 00002000:00000024:2.0:1789607694.388604:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607694.388672:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:5694:x1876539520060800:12345-192.168.202.3@tcp:13: Request processed in 108us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607694.388688:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00080000:1.0:1789607694.388818:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607694.404696:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607694.404781:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520060928 00000100:00100000:2.0:1789607694.404791:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520060928 00000100:00100000:2.0:1789607694.404856:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:2.0:1789607694.404865:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:5694:x1876539520060928:12345-192.168.202.3@tcp:13: 00002000:00000024:2.0:1789607694.404893:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607694.404957:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:5694:x1876539520060928:12345-192.168.202.3@tcp:13: Request processed in 92us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607694.404964:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00080000:1.0:1789607694.405716:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789607694.731734:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607694.988142:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607694.988185:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541054720:0@lo:13: 00000100:00100000:0.0:1789607694.988270:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607694.988448:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541054720 00000100:00100000:2.0:1789607694.988457:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541054720 00000100:00100000:2.0:1789607694.988541:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607694.988551:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541054720:12345-0@lo:13: 00002000:00000024:2.0:1789607694.988572:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607694.988616:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541054720:12345-0@lo:13: Request processed in 67us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607694.988623:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789607694.988688:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607694.991496:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4ac700 x1876539541054720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607694.991522:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541054720:0@lo:13: 00000001:00100000:3.0:1789607695.644957:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0d9aceb-01dc-4deb-add2-cd492a0443a6 00010000:00010000:0.0:1789607695.757237:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789607696.101403:0:5869:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d0d9aceb-01dc-4deb-add2-cd492a0443a6 00010000:00010000:2.0:1789607696.780760:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607697.204803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607697.204849:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607697.204887:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607697.205014:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520061312 00000100:00100000:0.0:1789607697.205024:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520061312 00000100:00100000:0.0:1789607697.205095:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:0.0:1789607697.205118:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520061312:12345-192.168.202.3@tcp:400: 00000100:00100000:0.0:1789607697.205211:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520061312:12345-192.168.202.3@tcp:400: Request processed in 95us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607697.205219:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00080000:0.0:1789607697.205242:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607697.205661:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520061056 00000100:00100000:1.0:1789607697.205667:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520061056 00000100:00100000:1.0:1789607697.205710:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 130 00000100:00100000:1.0:1789607697.205718:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2376:x1876539520061056:12345-192.168.202.3@tcp:400: 00000100:00100000:1.0:1789607697.205755:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2376:x1876539520061056:12345-192.168.202.3@tcp:400: Request processed in 38us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607697.205760:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 130 00000100:00100000:1.0:1789607697.206711:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607697.207270:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520061440 00000100:00100000:3.0:1789607697.207278:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520061440 00000100:00100000:3.0:1789607697.207351:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:3.0:1789607697.207361:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520061440:12345-192.168.202.3@tcp:400: 00000100:00100000:3.0:1789607697.207443:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520061440:12345-192.168.202.3@tcp:400: Request processed in 62us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607697.207452:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00080000:0.0:1789607697.207702:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607697.211240:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520061184 00000100:00100000:2.0:1789607697.211256:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520061184 00000100:00100000:1.0:1789607697.213868:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:1.0:1789607697.213883:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520061184:12345-192.168.202.3@tcp:400: 00000100:00100000:1.0:1789607697.214259:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520061184:12345-192.168.202.3@tcp:400: Request processed in 377us (9368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607697.214267:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00080000:0.0:1789607697.214412:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1789607697.802929:0:8306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789607697.804936:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607698.061197:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541055104:0@lo:400: 00000100:00100000:1.0:1789607698.061283:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607698.061343:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789607698.061350:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541054976:0@lo:400: 00000100:00100000:1.0:1789607698.061372:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607698.061387:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541055488:0@lo:400: 00000100:00100000:1.0:1789607698.061411:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607698.061525:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541054848:0@lo:400: 00000100:00100000:2.0:1789607698.061558:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607698.061589:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541055360:0@lo:400: 00000100:00100000:2.0:1789607698.061609:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607698.061627:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607698.061632:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541055232:0@lo:400: 00000100:00100000:2.0:1789607698.061654:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607698.061699:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541055104 00000100:00100000:2.0:1789607698.061707:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541055104 00000100:00100000:2.0:1789607698.061755:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541054976 00000100:00100000:2.0:1789607698.061759:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541054976 00000100:00100000:2.0:1789607698.061771:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541055360 00000100:00100000:2.0:1789607698.061773:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541055360 00000100:00100000:2.0:1789607698.061786:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789607698.061794:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541055104:12345-0@lo:400: 00000100:00100000:2.0:1789607698.061858:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541055104:12345-0@lo:400: Request processed in 65us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607698.061865:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789607698.061889:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607698.061894:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541054976:12345-0@lo:400: 00000100:00100000:2.0:1789607698.061922:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541054976:12345-0@lo:400: Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607698.061927:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607698.061937:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607698.061942:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541055360:12345-0@lo:400: 00000100:00100000:2.0:1789607698.061970:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541055360:12345-0@lo:400: Request processed in 29us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607698.061976:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607698.061999:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541055488 00000100:00100000:2.0:1789607698.062003:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541055488 00000100:00100000:2.0:1789607698.062027:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541055232 00000100:00100000:2.0:1789607698.062030:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541055232 00000100:00100000:2.0:1789607698.062045:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607698.062050:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541055488:12345-0@lo:400: 00000100:00100000:2.0:1789607698.062078:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541055488:12345-0@lo:400: Request processed in 28us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607698.062084:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607698.062095:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607698.062100:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541055232:12345-0@lo:400: 00000100:00100000:2.0:1789607698.062138:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541055232:12345-0@lo:400: Request processed in 38us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607698.062144:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789607698.062181:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c8d9a300 x1876539541055232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607698.062193:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541055232:0@lo:400: 00000100:00100000:2.0:1789607698.062212:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541055360:0@lo:400: 00000100:00100000:2.0:1789607698.062239:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541054976:0@lo:400: 00010000:00080000:2.0:1789607698.062249:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c8d98e00 x1876539541055488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607698.062257:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541055488:0@lo:400: 00000100:00100000:2.0:1789607698.062266:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541055104:0@lo:400: 00000100:00080000:0.0:1789607698.062696:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607698.062702:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607698.062705:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607698.063072:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541054848 00000100:00100000:1.0:1789607698.063080:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541054848 00000100:00100000:1.0:1789607698.063115:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789607698.063131:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541054848:12345-0@lo:400: 00000100:00100000:1.0:1789607698.063194:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541054848:12345-0@lo:400: Request processed in 74us (1636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607698.063201:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789607698.063273:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541054848:0@lo:400: 00000100:00100000:3.0:1789607698.571758:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607698.571788:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541055616:0@lo:13: 00000100:00100000:3.0:1789607698.571870:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607698.571947:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541055616 00000100:00100000:2.0:1789607698.571956:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541055616 00000100:00100000:2.0:1789607698.572014:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607698.572024:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541055616:12345-0@lo:13: 00002000:00000024:2.0:1789607698.572060:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607698.572127:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541055616:12345-0@lo:13: Request processed in 103us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607698.572134:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789607698.572257:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61c8380 x1876539541055616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607714 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607698.572274:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541055616:0@lo:13: 00010000:00010000:2.0:1789607698.830228:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607699.852470:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607700.107643:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541055744:0@lo:13: 00000100:00100000:0.0:1789607700.107723:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607700.107897:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541055744 00000100:00100000:2.0:1789607700.107905:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541055744 00000100:00100000:2.0:1789607700.107965:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789607700.107975:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541055744:12345-0@lo:13: 00002000:00000024:2.0:1789607700.108011:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607700.108056:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541055744:12345-0@lo:13: Request processed in 83us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607700.108063:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789607700.108122:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607700.108156:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4af800 x1876539541055744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607700.108174:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541055744:0@lo:13: 00010000:00010000:2.0:1789607700.875706:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789607701.694248:0:8455:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3d3281c0 20000000:00000080:2.0:1789607701.694266:0:8455:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a1ff530400 uarg=0000000000000000 20000000:01000000:2.0:1789607701.694294:0:8455:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789607701.694295:0:8455:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789607701.694298:0:8455:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789607701.694302:0:8455:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789607701.694306:0:8455:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789607701.694320:0:8455:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789607701.694322:0:8455:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789607701.694685:0:8455:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789607701.694688:0:8455:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789607701.695331:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789607701.695761:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789607701.695896:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789607701.695918:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789607701.695927:0:8455:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789607701.695928:0:8455:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789607701.696653:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1789607701.696914:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1789607701.696942:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1789607701.696968:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1789607701.696977:0:8455:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789607701.696979:0:8455:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789607701.697511:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789607701.697832:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789607701.697878:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789607701.697900:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1789607701.697909:0:8455:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789607701.697910:0:8455:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789607701.698391:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1789607701.698635:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1789607701.698669:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1789607701.698688:0:8455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1789607701.698699:0:8455:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789607701.698716:0:8455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.698730:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385f1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f14 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.698744:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d8d7f800/0x33f091d001385f45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f3e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.698748:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d103b400/0x33f091d001385f6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f68 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.698752:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1c167de00/0x33f091d001385f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f76 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.698756:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d103a600/0x33f091d001385f8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f84 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.698760:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1f558fa00/0x33f091d001385fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385fa0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.698763:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1c167c800/0x33f091d001385fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385fca expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.698842:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d8d7e600/0x33f091d001385fdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9452 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.698851:0:8455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d8d7f400/0x33f091d001385fe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9459 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.698858:0:8455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.698895:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d8d7f400/0x33f091d001385fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9459 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.698916:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1d8d7f400/0x33f091d001385fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9459 expref: 9 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607701.698927:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541055872:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607701.699049:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d8d7e600/0x33f091d001385fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9452 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.699055:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1d8d7e600/0x33f091d001385fdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9452 expref: 9 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607701.699061:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056000:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607701.699095:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1c167c800/0x33f091d001385fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385fca expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.699103:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1c167c800/0x33f091d001385fd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385fca expref: 18 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607701.699112:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d99180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056128:0@lo:104: 00000100:00100000:1.0:1789607701.699153:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607701.699190:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1f558fa00/0x33f091d001385fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385fa0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.699195:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1f558fa00/0x33f091d001385fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385fa0 expref: 18 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607701.699201:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056256:0@lo:104: 00000100:00100000:1.0:1789607701.699216:0:8455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607701.699236:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d103a600/0x33f091d001385f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385f84 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.699242:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d103a600/0x33f091d001385f8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385f84 expref: 18 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607701.699247:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056384:0@lo:104: 00010000:00010000:1.0:1789607701.699260:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1c167de00/0x33f091d001385f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385f76 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.699265:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1c167de00/0x33f091d001385f7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385f76 expref: 18 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607701.699270:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056512:0@lo:104: 00010000:00010000:1.0:1789607701.699280:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d103b400/0x33f091d001385f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385f68 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.699284:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d103b400/0x33f091d001385f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385f68 expref: 18 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607701.699288:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056640:0@lo:104: 00010000:00010000:1.0:1789607701.699299:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d8d7f800/0x33f091d001385f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385f3e expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.699303:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d8d7f800/0x33f091d001385f45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385f3e expref: 18 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607701.699308:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056768:0@lo:104: 00010000:00010000:1.0:1789607701.699328:0:8455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385f14 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607701.699339:0:8455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385f1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385f14 expref: 18 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607701.699344:0:8455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056896:0@lo:104: 00000100:00100000:1.0:1789607701.699356:0:8455:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f92ec840 going to sleep for 11 seconds 00000100:00100000:3.0:1789607701.699512:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789607701.699527:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607701.699536:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607701.699541:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607701.699546:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607701.699551:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607701.699556:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541056128 00000100:00100000:3.0:1789607701.699562:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541056128 00000100:00100000:3.0:1789607701.699590:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541056256 00000100:00100000:3.0:1789607701.699592:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541056256 00000100:00100000:3.0:1789607701.699597:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541056384 00000100:00100000:3.0:1789607701.699598:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541056384 00000100:00100000:3.0:1789607701.699603:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541056512 00000100:00100000:3.0:1789607701.699605:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541056512 00000100:00100000:3.0:1789607701.699610:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541056640 00000100:00100000:3.0:1789607701.699611:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541056640 00000100:00100000:3.0:1789607701.699615:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541056768 00000100:00100000:3.0:1789607701.699616:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541056768 00000100:00100000:3.0:1789607701.699622:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541056896 00000100:00100000:3.0:1789607701.699623:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541056896 00000100:00100000:3.0:1789607701.699632:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607701.699637:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:8455:x1876539541056128:12345-0@lo:104: 00010000:00010000:3.0:1789607701.699648:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385fd1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.699695:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789607701.699704:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+9:8455:x1876539541056128:12345-0@lo:104: Request processed in 66us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.699709:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607701.699722:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607701.699726:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1fad94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+8:8455:x1876539541056256:12345-0@lo:104: 00010000:00010000:3.0:1789607701.699732:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385fa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.699762:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789607701.699766:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1fad94c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+8:8455:x1876539541056256:12345-0@lo:104: Request processed in 40us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.699780:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607701.699810:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607701.699816:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+7:8455:x1876539541056384:12345-0@lo:104: 00010000:00010000:3.0:1789607701.699824:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385f8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.699850:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789607701.699855:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+7:8455:x1876539541056384:12345-0@lo:104: Request processed in 39us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.699860:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607701.699871:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789607701.699875:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+6:8455:x1876539541056512:12345-0@lo:104: 00010000:00010000:3.0:1789607701.699880:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385f7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.699898:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789607701.699905:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+6:8455:x1876539541056512:12345-0@lo:104: Request processed in 30us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.699909:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789607701.699916:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789607701.699920:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:8455:x1876539541056640:12345-0@lo:104: 00010000:00010000:3.0:1789607701.699924:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385f6f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.699940:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789607701.699943:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:8455:x1876539541056640:12345-0@lo:104: Request processed in 23us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.699946:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789607701.699951:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789607701.699954:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee291180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:8455:x1876539541056768:12345-0@lo:104: 00010000:00010000:3.0:1789607701.699957:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385f45 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.699970:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1789607701.699973:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee291180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:8455:x1876539541056768:12345-0@lo:104: Request processed in 19us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.699976:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789607701.699982:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789607701.699985:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee290380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:8455:x1876539541056896:12345-0@lo:104: 00010000:00010000:3.0:1789607701.699989:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385f1b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700000:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1789607701.700007:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee290380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:8455:x1876539541056896:12345-0@lo:104: Request processed in 22us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.700011:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607701.700330:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d99180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056128:0@lo:104: 00000100:00100000:1.0:1789607701.700337:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056256:0@lo:104: 00000100:00100000:1.0:1789607701.700341:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056384:0@lo:104: 00000100:00100000:1.0:1789607701.700344:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056512:0@lo:104: 00000100:00100000:1.0:1789607701.700348:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056640:0@lo:104: 00000100:00100000:1.0:1789607701.700351:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056768:0@lo:104: 00000100:00100000:1.0:1789607701.700355:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056896:0@lo:104: 00010000:00010000:3.0:1789607701.700514:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1789607701.700521:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385fd1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700529:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d8d7ee00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607701.700534:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385fd1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700541:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385fd1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607701.700549:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385fd1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607701.700554:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607701.700587:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385fd1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700592:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607701.700612:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385fd1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700617:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ee00/0x33f091d001385fca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385fd1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700626:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789607701.700628:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385fa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700639:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c167cc00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607701.700641:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385fa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700646:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385fa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607701.700649:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385fa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607701.700652:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607701.700662:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385fa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700665:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607701.700674:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385fa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700678:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c167cc00/0x33f091d001385fa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385fa7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700684:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789607701.700686:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385f8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700689:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b200 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607701.700690:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385f8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700701:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385f8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607701.700704:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385f8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607701.700707:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607701.700717:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700721:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607701.700726:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700732:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d103b200/0x33f091d001385f84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f8b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700740:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789607701.700743:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385f7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700748:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103ac00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607701.700751:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385f7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700760:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385f7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607701.700849:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541057024:0@lo:103: 00000100:00100000:1.0:1789607701.700885:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1789607701.700934:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385f7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607701.700943:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607701.700954:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700957:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607701.700969:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700974:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d103ac00/0x33f091d001385f76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f7d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700979:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789607701.700981:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385f6f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700984:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d8d7fe00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607701.700986:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385f6f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.700990:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385f6f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607701.700994:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385f6f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607701.700996:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607701.701003:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f6f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701006:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607701.701013:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f6f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701017:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7fe00/0x33f091d001385f68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f6f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701022:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607701.701080:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385f45 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701095:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b600 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607701.701098:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385f45 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701104:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385f45 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607701.701111:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385f45 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607701.701116:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607701.701131:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f45 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701136:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607701.701139:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f45 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701143:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d001385f3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f45 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701149:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607701.701155:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385f1b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701160:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c167c400 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607701.701163:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385f1b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701169:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385f1b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607701.701176:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385f1b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607701.701180:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789607701.701193:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f1b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701198:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607701.701203:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f1b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701209:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c167c400/0x33f091d001385f14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f1b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701223:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607701.701224:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607701.701225:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607701.701234:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541057408:0@lo:103: 00000100:00100000:3.0:1789607701.701255:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607701.701269:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607701.701272:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541057536:0@lo:103: 00000100:00100000:3.0:1789607701.701300:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607701.701317:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541057152:0@lo:103: 00000100:00100000:3.0:1789607701.701331:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607701.701336:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541057664:0@lo:103: 00000100:00100000:3.0:1789607701.701345:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607701.701350:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789607701.701353:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541057280:0@lo:103: 00000100:00100000:3.0:1789607701.701362:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607701.701366:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541057792:0@lo:103: 00000100:00100000:3.0:1789607701.701376:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607701.701388:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541057024 00000100:00100000:3.0:1789607701.701392:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541057024 00010000:00010000:3.0:1789607701.701412:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1c167c800/0x33f091d001385fd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385fca expref: 19 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607701.701455:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541057408 00000100:00100000:3.0:1789607701.701458:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541057408 00010000:00010000:3.0:1789607701.701469:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1c167de00/0x33f091d001385f7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385f76 expref: 20 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607701.701477:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541057536 00000100:00100000:3.0:1789607701.701479:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541057536 00010000:00010000:3.0:1789607701.701484:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d103b400/0x33f091d001385f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385f68 expref: 21 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607701.701489:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541057152 00000100:00100000:3.0:1789607701.701490:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541057152 00010000:00010000:3.0:1789607701.701495:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1f558fa00/0x33f091d001385fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385fa0 expref: 22 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607701.701510:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541057664 00000100:00100000:3.0:1789607701.701511:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541057664 00010000:00010000:3.0:1789607701.701518:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d8d7f800/0x33f091d001385f45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385f3e expref: 23 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607701.701523:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541057280 00000100:00100000:3.0:1789607701.701524:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541057280 00010000:00010000:3.0:1789607701.701529:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d103a600/0x33f091d001385f8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385f84 expref: 24 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607701.701533:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541057792 00000100:00100000:3.0:1789607701.701535:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541057792 00010000:00010000:3.0:1789607701.701540:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385f1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385f14 expref: 25 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607701.701546:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607701.701550:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+25:3310:x1876539541057024:12345-0@lo:103: 00010000:00010000:3.0:1789607701.701558:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607701.701561:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1c167c800/0x33f091d001385fd1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385fca expref: 25 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701567:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1c167c800/0x33f091d001385fd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385fca expref: 25 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701577:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167c800/0x33f091d001385fd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385fca expref: 25 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701586:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607701.701605:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+24:3310:x1876539541057024:12345-0@lo:103: Request processed in 54us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.701616:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789607701.701628:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607701.701631:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+23:3309:x1876539541057408:12345-0@lo:103: 00010000:00010000:3.0:1789607701.701636:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607701.701639:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1c167de00/0x33f091d001385f7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385f76 expref: 23 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701644:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1c167de00/0x33f091d001385f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385f76 expref: 23 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701650:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167de00/0x33f091d001385f7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385f76 expref: 23 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701656:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607701.701674:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+22:3309:x1876539541057408:12345-0@lo:103: Request processed in 43us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.701677:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607701.701684:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607701.701687:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+21:3309:x1876539541057536:12345-0@lo:103: 00010000:00010000:3.0:1789607701.701692:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607701.701694:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d103b400/0x33f091d001385f6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385f68 expref: 21 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701699:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d103b400/0x33f091d001385f6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385f68 expref: 21 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701704:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103b400/0x33f091d001385f6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385f68 expref: 21 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701717:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607701.701732:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+20:3309:x1876539541057536:12345-0@lo:103: Request processed in 44us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.701736:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607701.701744:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789607701.701747:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3311:x1876539541057152:12345-0@lo:103: 00010000:00010000:3.0:1789607701.701752:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607701.701754:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1f558fa00/0x33f091d001385fa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385fa0 expref: 19 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701759:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1f558fa00/0x33f091d001385fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385fa0 expref: 19 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.701765:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1f558fa00/0x33f091d001385fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385fa0 expref: 19 pid: 5839 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607701.701879:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541057024:0@lo:103: 00010000:00010000:3.0:1789607701.701980:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607701.702107:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:3311:x1876539541057152:12345-0@lo:103: Request processed in 358us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.702114:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789607701.702129:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789607701.702135:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:3311:x1876539541057664:12345-0@lo:103: 00010000:00010000:3.0:1789607701.702144:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607701.702147:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d8d7f800/0x33f091d001385f45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385f3e expref: 17 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.702153:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d8d7f800/0x33f091d001385f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385f3e expref: 17 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.702165:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d8d7f800/0x33f091d001385f45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385f3e expref: 17 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.702171:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607701.702199:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:3311:x1876539541057664:12345-0@lo:103: Request processed in 65us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.702203:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789607701.702212:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789607701.702216:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:3311:x1876539541057280:12345-0@lo:103: 00010000:00010000:3.0:1789607701.702220:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607701.702223:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d103a600/0x33f091d001385f8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385f84 expref: 15 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.702228:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d103a600/0x33f091d001385f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385f84 expref: 15 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.702234:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103a600/0x33f091d001385f8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385f84 expref: 15 pid: 5842 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.702239:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607701.702251:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:3311:x1876539541057280:12345-0@lo:103: Request processed in 35us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.702254:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789607701.702260:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789607701.702263:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:3311:x1876539541057792:12345-0@lo:103: 00010000:00010000:3.0:1789607701.702268:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607701.702270:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385f1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385f14 expref: 13 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.702279:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385f1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385f14 expref: 13 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.702286:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d8d7fa00/0x33f091d001385f1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385f14 expref: 13 pid: 5841 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.702291:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607701.702305:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c70450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:3311:x1876539541057792:12345-0@lo:103: Request processed in 42us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.702308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789607701.702341:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541057536:0@lo:103: 00000100:00100000:3.0:1789607701.702346:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541057408:0@lo:103: 00010000:00010000:3.0:1789607701.703974:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607701.705555:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541057152:0@lo:103: 00000100:00100000:0.0:1789607701.705565:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541057664:0@lo:103: 00000100:00100000:0.0:1789607701.705582:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541057280:0@lo:103: 00000100:00100000:0.0:1789607701.705587:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541057792:0@lo:103: 00000100:00100000:0.0:1789607701.705847:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607701.705951:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607701.705996:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541055872:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607701.706006:0:8455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8455:1876539541056000:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607701.706061:0:8455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607701.706682:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520061568 00000100:00100000:2.0:1789607701.706689:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520061568 00010000:00010000:2.0:1789607701.706717:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d8d7f400/0x33f091d001385fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9459 expref: 10 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607701.706773:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520061696 00000100:00100000:2.0:1789607701.706775:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520061696 00010000:00010000:2.0:1789607701.706785:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d8d7e600/0x33f091d001385fdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9452 expref: 11 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607701.706864:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:3.0:1789607701.706873:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:2374:x1876539520061568:12345-192.168.202.3@tcp:103: 00010000:00010000:3.0:1789607701.706886:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607701.706890:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d8d7f400/0x33f091d001385fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9459 expref: 11 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.706898:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d8d7f400/0x33f091d001385fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9459 expref: 11 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.706923:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d8d7f400/0x33f091d001385fe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9459 expref: 11 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.706936:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607701.706990:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2374:x1876539520061568:12345-192.168.202.3@tcp:103: Request processed in 117us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.706998:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:3.0:1789607701.707020:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:3.0:1789607701.707037:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:2373:x1876539520061696:12345-192.168.202.3@tcp:103: 00010000:00010000:3.0:1789607701.707043:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607701.707046:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d8d7e600/0x33f091d001385fdf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9452 expref: 9 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.707052:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d8d7e600/0x33f091d001385fdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9452 expref: 9 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.707059:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d8d7e600/0x33f091d001385fdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9452 expref: 9 pid: 5842 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.707069:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.707077:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.707102:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.707109:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.707122:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.707129:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.707136:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c167dc00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:3.0:1789607701.707140:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.707149:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.707162:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.707168:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607701.707184:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:2373:x1876539520061696:12345-192.168.202.3@tcp:103: Request processed in 159us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607701.707189:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00010000:00010000:3.0:1789607701.708485:0:8455:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.708498:0:8455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.708503:0:8455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167dc00/0x33f091d00138601e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607701.901481:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607702.321544:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607702.321592:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607702.321630:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607702.321668:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607702.321700:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520062208 00000100:00100000:2.0:1789607702.321709:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520062208 00000100:00100000:2.0:1789607702.321763:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520062080 00000100:00100000:2.0:1789607702.321767:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520062080 00000100:00100000:2.0:1789607702.321787:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:2.0:1789607702.321797:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520062208:12345-192.168.202.3@tcp:400: 00000100:00100000:2.0:1789607702.321868:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520062208:12345-192.168.202.3@tcp:400: Request processed in 71us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607702.321880:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789607702.321891:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789607702.321895:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:2.0:1789607702.321916:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:2.0:1789607702.321924:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520062080:12345-192.168.202.3@tcp:400: 00000100:00100000:2.0:1789607702.321951:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520062080:12345-192.168.202.3@tcp:400: Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607702.321958:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00080000:2.0:1789607702.321975:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607702.321979:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607702.322327:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520061952 00000100:00100000:3.0:1789607702.322344:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520061952 00000100:00100000:3.0:1789607702.322396:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:3.0:1789607702.322404:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2375:x1876539520061952:12345-192.168.202.3@tcp:400: 00000100:00100000:3.0:1789607702.322467:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2375:x1876539520061952:12345-192.168.202.3@tcp:400: Request processed in 64us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607702.322475:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00080000:2.0:1789607702.322730:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607702.322858:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520061824 00000100:00100000:0.0:1789607702.322864:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520061824 00000100:00100000:0.0:1789607702.322914:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 132 00000100:00100000:0.0:1789607702.322923:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:2376:x1876539520061824:12345-192.168.202.3@tcp:400: 00000100:00100000:0.0:1789607702.322958:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:2376:x1876539520061824:12345-192.168.202.3@tcp:400: Request processed in 37us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607702.322965:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 132 00010000:00010000:3.0:1789607702.923594:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789607703.115551:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789607703.115559:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a1e8ccd800 from 39 10000000:01000000:0.0:1789607703.115564:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789607703.115619:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.115631:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.115644:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607703.115669:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541057920:0@lo:101: 00000100:00100000:0.0:1789607703.115739:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607703.115805:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.115889:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541057920 00000100:00100000:2.0:1789607703.115898:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541057920 00000100:00100000:2.0:1789607703.115949:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789607703.115958:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+12:5845:x1876539541057920:12345-0@lo:101: 00010000:00010000:2.0:1789607703.115970:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607703.115983:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c1511e00/0x33f091d00138602c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001386025 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.116004:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c1511e00/0x33f091d00138602c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001386025 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.116015:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c1511e00/0x33f091d00138602c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001386025 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.116024:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1511e00, rc 0) 00000100:00100000:2.0:1789607703.116082:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541057920:12345-0@lo:101: Request processed in 125us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.116089:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789607703.116241:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541057920:0@lo:101: 00010000:00010000:1.0:1789607703.116256:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607703.116265:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607703.116328:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541058048:0@lo:501: 00000100:00100000:1.0:1789607703.116353:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607703.116382:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f92ec900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.116458:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541058048 00000100:00100000:2.0:1789607703.116463:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541058048 00000100:00100000:2.0:1789607703.116493:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789607703.116499:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541058048:12345-0@lo:501: 00000100:00100000:2.0:1789607703.116780:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541058048:12345-0@lo:501: Request processed in 280us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.116787:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789607703.117861:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541058048:0@lo:501: 00000100:00100000:0.0:1789607703.117904:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541058176:0@lo:503: 00000100:00100000:0.0:1789607703.117952:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607703.117994:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607703.118116:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541058176 00000100:00100000:3.0:1789607703.118122:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541058176 00000100:00100000:3.0:1789607703.118163:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789607703.118170:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541058176:12345-0@lo:503: 00000100:00100000:3.0:1789607703.118326:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541058176:12345-0@lo:503: Request processed in 156us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607703.118332:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789607703.118486:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541058176:0@lo:503: 00000100:00100000:0.0:1789607703.118793:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8472:1876539541058304:0@lo:502: 00000100:00100000:0.0:1789607703.118828:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607703.118863:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607703.118874:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541058304 00000100:00100000:1.0:1789607703.118879:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541058304 00000100:00100000:1.0:1789607703.118916:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789607703.118922:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:8472:x1876539541058304:12345-0@lo:502: 00000100:00100000:1.0:1789607703.119052:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:8472:x1876539541058304:12345-0@lo:502: Request processed in 130us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.119059:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789607703.119091:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8472:1876539541058304:0@lo:502: 00000100:00100000:0.0:1789607703.119126:0:8472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8472:1876539541058432:0@lo:502: 00000100:00100000:0.0:1789607703.119155:0:8472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607703.119179:0:8472:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.119315:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541058432 00000100:00100000:2.0:1789607703.119318:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541058432 00000100:00100000:2.0:1789607703.119341:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789607703.119346:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:8472:x1876539541058432:12345-0@lo:502: 00000100:00100000:2.0:1789607703.119459:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:8472:x1876539541058432:12345-0@lo:502: Request processed in 111us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.119466:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789607703.119491:0:8472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8472:1876539541058432:0@lo:502: 00000040:00080000:0.0:1789607703.119509:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789607703.119595:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789607703.119611:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789607703.119619:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.119630:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607703.119639:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789607703.119642:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789607703.119644:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789607703.119666:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.119672:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.119684:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607703.119692:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541058560:0@lo:101: 00000100:00100000:2.0:1789607703.119710:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607703.119731:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e89d8540 going to sleep for 11 seconds 00000100:00100000:1.0:1789607703.119766:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541058560 00000100:00100000:1.0:1789607703.119769:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541058560 00000100:00100000:1.0:1789607703.119789:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789607703.119793:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+13:5845:x1876539541058560:12345-0@lo:101: 00010000:00010000:1.0:1789607703.119799:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607703.119809:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c167d400/0x33f091d00138603a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001386033 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607703.119824:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c167d400/0x33f091d00138603a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001386033 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607703.119831:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c167d400/0x33f091d00138603a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001386033 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607703.119836:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c167d400, rc 0) 00000100:00100000:1.0:1789607703.119862:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541058560:12345-0@lo:101: Request processed in 69us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.119872:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789607703.119939:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541058560:0@lo:101: 00010000:00010000:2.0:1789607703.119947:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.119952:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607703.119979:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541058688:0@lo:501: 00000100:00100000:2.0:1789607703.119994:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607703.120008:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e89d8540 going to sleep for 11 seconds 00000100:00100000:1.0:1789607703.120099:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541058688 00000100:00100000:1.0:1789607703.120103:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541058688 00000100:00100000:1.0:1789607703.120134:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789607703.120141:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541058688:12345-0@lo:501: 00000100:00100000:1.0:1789607703.120396:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541058688:12345-0@lo:501: Request processed in 256us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.120402:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789607703.124204:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541058688:0@lo:501: 00000100:00100000:3.0:1789607703.124276:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541058816:0@lo:503: 00000100:00100000:3.0:1789607703.124364:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.124420:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789607703.125752:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541058816 00000100:00100000:0.0:1789607703.125764:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541058816 00000100:00100000:0.0:1789607703.125827:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789607703.125837:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541058816:12345-0@lo:503: 00000100:00100000:0.0:1789607703.126068:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541058816:12345-0@lo:503: Request processed in 233us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607703.126088:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789607703.126138:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541058816:0@lo:503: 00000100:00100000:3.0:1789607703.126564:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8473:1876539541058944:0@lo:502: 00000100:00100000:3.0:1789607703.126608:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.126644:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.126698:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541058944 00000100:00100000:2.0:1789607703.126704:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541058944 00000100:00100000:2.0:1789607703.126736:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789607703.126744:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:8473:x1876539541058944:12345-0@lo:502: 00000100:00100000:2.0:1789607703.126906:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:8473:x1876539541058944:12345-0@lo:502: Request processed in 162us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.126913:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789607703.127068:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8473:1876539541058944:0@lo:502: 00000020:01000000:3.0:1789607703.127101:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607703.127115:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607703.127118:0:8473:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789607703.127124:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789607703.127146:0:8473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8473:1876539541059072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607703.127178:0:8473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.127205:0:8473:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607703.127259:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541059072 00000100:00100000:0.0:1789607703.127263:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541059072 00000100:00100000:0.0:1789607703.127295:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789607703.127302:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:8473:x1876539541059072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607703.127448:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:8473:x1876539541059072:12345-0@lo:502:llog_process_th.0 Request processed in 145us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607703.127455:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789607703.127644:0:8473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8473:1876539541059072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789607703.127664:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607703.127668:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607703.127670:0:8473:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789607703.127675:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789607703.127888:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789607703.127907:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789607703.127917:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.127929:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607703.127946:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789607703.127949:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a1c8d84800 from 39 10000000:01000000:0.0:1789607703.127952:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789607703.127977:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.127985:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.127995:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607703.128025:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541059200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789607703.128059:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607703.128098:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.128201:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541059200 00000100:00100000:2.0:1789607703.128207:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541059200 00000100:00100000:2.0:1789607703.128241:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789607703.128249:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:5845:x1876539541059200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607703.128266:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607703.128281:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c1510a00/0x33f091d001386048 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001386041 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.128304:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c1510a00/0x33f091d001386048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001386041 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.128315:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c1510a00/0x33f091d001386048 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001386041 expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.128324:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1510a00, rc 0) 00000100:00100000:2.0:1789607703.128366:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541059200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.128373:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789607703.128513:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541059200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607703.128527:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.128536:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607703.128581:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541059328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607703.128605:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607703.128632:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.128704:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541059328 00000100:00100000:2.0:1789607703.128709:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541059328 00000100:00100000:2.0:1789607703.128784:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789607703.128791:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541059328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607703.129044:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541059328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.129051:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789607703.129300:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541059328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607703.129331:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541059456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607703.129374:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607703.150005:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08540 going to sleep for 11 seconds 00000100:00100000:1.0:1789607703.150036:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541059456 00000100:00100000:1.0:1789607703.150048:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541059456 00000100:00100000:1.0:1789607703.150111:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789607703.150122:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541059456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607703.150450:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541059456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 330us (21075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.150458:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789607703.151319:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541059456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.153401:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8474:1876539541059584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607703.153493:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.153529:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607703.153538:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541059584 00000100:00100000:1.0:1789607703.153545:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541059584 00000100:00100000:1.0:1789607703.153594:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789607703.153603:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:8474:x1876539541059584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607703.153850:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:8474:x1876539541059584:12345-0@lo:502:llog_process_th.0 Request processed in 247us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.153858:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789607703.154126:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8474:1876539541059584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607703.154166:0:8474:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8474:1876539541059712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607703.154190:0:8474:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.154212:0:8474:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789607703.154244:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541059712 00000100:00100000:0.0:1789607703.154248:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541059712 00000100:00100000:0.0:1789607703.154272:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789607703.154277:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:8474:x1876539541059712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607703.154453:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:8474:x1876539541059712:12345-0@lo:502:llog_process_th.0 Request processed in 174us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607703.154461:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789607703.154556:0:8474:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8474:1876539541059712:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789607703.154570:0:8474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789607703.154967:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789607703.154987:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789607703.154996:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.155006:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607703.155016:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789607703.155087:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789607703.155092:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789607703.155124:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.155132:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.155140:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607703.155163:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541059840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789607703.155194:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607703.155266:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607703.155386:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541059840 00000100:00100000:1.0:1789607703.155392:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541059840 00000100:00100000:1.0:1789607703.159166:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789607703.159189:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:5845:x1876539541059840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607703.159224:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607703.159245:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c167cc00/0x33f091d001386056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d00138604f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607703.159272:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c167cc00/0x33f091d001386056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d00138604f expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607703.159284:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c167cc00/0x33f091d001386056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138604f expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607703.159292:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c167cc00, rc 0) 00000100:00100000:1.0:1789607703.159390:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541059840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (4195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.159398:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789607703.159564:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541059840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607703.159583:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607703.159592:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607703.159676:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541059968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.159729:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607703.161908:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541059968 00000100:00100000:1.0:1789607703.161919:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541059968 00000100:00100000:1.0:1789607703.161955:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789607703.161964:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541059968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607703.163238:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541059968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1270us (3503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.163250:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789607703.163482:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789607703.163508:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541059968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.163555:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541060096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.163595:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.163618:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607703.163668:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541060096 00000100:00100000:1.0:1789607703.163674:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541060096 00000100:00100000:1.0:1789607703.163696:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789607703.163702:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541060096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607703.163923:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541060096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.163937:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789607703.164003:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541060096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.164844:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8475:1876539541060224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607703.164886:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.164911:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607703.165106:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541060224 00000100:00100000:1.0:1789607703.165112:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541060224 00000100:00100000:1.0:1789607703.165136:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789607703.165143:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:8475:x1876539541060224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607703.165306:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:8475:x1876539541060224:12345-0@lo:502:llog_process_th.0 Request processed in 163us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.165314:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789607703.165395:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8475:1876539541060224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789607703.165418:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607703.165442:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607703.165445:0:8475:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789607703.165450:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789607703.165469:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8475:1876539541060352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607703.165501:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.165519:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607703.165599:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541060352 00000100:00100000:1.0:1789607703.165603:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541060352 00000100:00100000:1.0:1789607703.165670:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789607703.165677:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:8475:x1876539541060352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607703.165800:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:8475:x1876539541060352:12345-0@lo:502:llog_process_th.0 Request processed in 122us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.165806:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789607703.165858:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8475:1876539541060352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789607703.165873:0:8475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607703.165877:0:8475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607703.165879:0:8475:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789607703.165887:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1789607703.165932:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789607703.165948:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789607703.165957:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607703.165968:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607703.165977:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789607703.165980:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a1c98a7800 from 39 10000000:01000000:3.0:1789607703.165983:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789607703.166005:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607703.166023:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607703.166033:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607703.166046:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541060480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.166722:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.172748:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789607703.174141:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541060480 00000100:00100000:0.0:1789607703.174153:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541060480 00000100:00100000:0.0:1789607703.174211:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789607703.174220:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541060480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607703.174236:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607703.174255:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103ac00/0x33f091d001386064 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d00138605d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.174283:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103ac00/0x33f091d001386064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d00138605d expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.174294:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103ac00/0x33f091d001386064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138605d expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.174304:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103ac00, rc 0) 00000100:00100000:0.0:1789607703.174491:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541060480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 272us (7770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607703.174499:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789607703.174694:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541060480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607703.174711:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607703.174721:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607703.174800:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541060608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.174834:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.174900:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789607703.174929:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541060608 00000100:00100000:0.0:1789607703.174933:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541060608 00000100:00100000:0.0:1789607703.174994:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789607703.175001:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541060608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607703.175266:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541060608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607703.175281:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789607703.175343:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541060608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.175371:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541060736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.175405:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.175689:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.175769:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541060736 00000100:00100000:2.0:1789607703.175775:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541060736 00000100:00100000:2.0:1789607703.175800:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789607703.175806:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541060736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607703.176179:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541060736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 372us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607703.176182:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541060736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607703.176195:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789607703.181205:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876539541060992:0@lo:400:kworker.0 00000100:00100000:1.0:1789607703.181290:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607703.181350:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789607703.181357:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffaffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541060864:0@lo:400:kworker.0 00000100:00100000:1.0:1789607703.181378:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607703.181398:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541061376:0@lo:400:kworker.0 00000100:00100000:1.0:1789607703.181443:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607703.181468:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541061120:0@lo:400:kworker.0 00000100:00100000:1.0:1789607703.181488:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607703.181503:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607703.181523:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876539541061248:0@lo:400:kworker.0 00000100:00100000:1.0:1789607703.181543:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607703.181575:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541060992 00000100:00100000:1.0:1789607703.181582:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541060992 00000100:00100000:1.0:1789607703.181633:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541060864 00000100:00100000:1.0:1789607703.181635:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541060864 00000100:00100000:1.0:1789607703.181645:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541061248 00000100:00100000:1.0:1789607703.181647:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541061248 00000100:00100000:1.0:1789607703.181663:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607703.181671:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffaff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876539541060992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607703.181716:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffaff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876539541060992:12345-0@lo:400:kworker.0 Request processed in 46us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.181723:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607703.181740:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607703.181745:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541060864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607703.181770:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541060864:12345-0@lo:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.181776:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789607703.181785:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789607703.181790:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876539541061248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607703.181814:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876539541061248:12345-0@lo:400:kworker.0 Request processed in 24us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607703.181820:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789607703.181866:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876539541061248:0@lo:400:kworker.0 00000100:00100000:1.0:1789607703.181887:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffaffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541060864:0@lo:400:kworker.0 00000100:00100000:1.0:1789607703.181895:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876539541060992:0@lo:400:kworker.0 00000100:00100000:2.0:1789607703.182686:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541061376 00000100:00100000:2.0:1789607703.182693:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541061376 00000100:00100000:2.0:1789607703.182783:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541061120 00000100:00100000:2.0:1789607703.182787:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541061120 00000100:00100000:2.0:1789607703.182811:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607703.182819:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541061376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607703.183109:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541061376:12345-0@lo:400:kworker.0 Request processed in 290us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.183117:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607703.183136:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789607703.183143:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541061120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607703.183174:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541061120:12345-0@lo:400:kworker.0 Request processed in 33us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.183180:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789607703.183195:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607703.183199:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607703.183202:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789607703.183231:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffafc380 x1876539541061376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607703.183243:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541061376:0@lo:400:kworker.0 00010000:00080000:1.0:1789607703.184614:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffafd500 x1876539541061120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607703.184628:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541061120:0@lo:400:kworker.0 00000100:00100000:3.0:1789607703.190290:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8476:1876539541061504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607703.190387:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.190479:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.190531:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541061504 00000100:00100000:2.0:1789607703.190538:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541061504 00000100:00100000:2.0:1789607703.190584:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789607703.190593:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:8476:x1876539541061504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607703.190831:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:8476:x1876539541061504:12345-0@lo:502:llog_process_th.0 Request processed in 238us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.190844:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789607703.192239:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8476:1876539541061504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607703.192316:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8476:1876539541061632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607703.192371:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.192411:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.192493:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541061632 00000100:00100000:2.0:1789607703.192500:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541061632 00000100:00100000:2.0:1789607703.192547:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789607703.192559:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:8476:x1876539541061632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607703.192777:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:8476:x1876539541061632:12345-0@lo:502:llog_process_th.0 Request processed in 223us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.192785:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789607703.192791:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8476:1876539541061632:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789607703.192808:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789607703.193748:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789607703.193773:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789607703.193782:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.193791:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607703.193798:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789607703.193800:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789607703.193802:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789607703.193826:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.193832:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.193839:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607703.193852:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541061760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607703.193902:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607703.193938:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8d4e840 going to sleep for 11 seconds 00000100:00100000:0.0:1789607703.194160:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541061760 00000100:00100000:0.0:1789607703.194167:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541061760 00000100:00100000:0.0:1789607703.194204:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789607703.194211:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541061760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607703.194222:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607703.194233:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103b200/0x33f091d001386072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d00138606b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.194253:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103b200/0x33f091d001386072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d00138606b expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.194263:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103b200/0x33f091d001386072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138606b expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.194271:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b200, rc 0) 00000100:00100000:0.0:1789607703.194307:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541061760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607703.194313:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789607703.194334:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541061760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607703.194348:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607703.194357:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607703.194402:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541061888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.194462:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.194488:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.194819:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541061888 00000100:00100000:2.0:1789607703.194823:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541061888 00000100:00100000:2.0:1789607703.194838:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789607703.194842:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541061888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607703.195047:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541061888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.195054:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789607703.195067:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541061888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.195108:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541062016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.195143:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607703.195165:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.195180:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541062016 00000100:00100000:2.0:1789607703.195184:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541062016 00000100:00100000:2.0:1789607703.195206:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789607703.195212:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541062016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607703.195337:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541062016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.195344:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789607703.195470:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541062016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607703.196853:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8477:1876539541062144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607703.196910:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607703.196943:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8d9d180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607703.196987:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541062144 00000100:00100000:3.0:1789607703.196993:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541062144 00000100:00100000:3.0:1789607703.197037:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789607703.197044:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:8477:x1876539541062144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607703.197255:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:8477:x1876539541062144:12345-0@lo:502:llog_process_th.0 Request processed in 210us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607703.197262:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789607703.197342:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8477:1876539541062144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789607703.197366:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607703.197375:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607703.197378:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789607703.197383:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789607703.197402:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201656a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8477:1876539541062272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607703.197460:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607703.197477:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.197581:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541062272 00000100:00100000:2.0:1789607703.197586:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541062272 00000100:00100000:2.0:1789607703.197614:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789607703.197621:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:8477:x1876539541062272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607703.197740:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:8477:x1876539541062272:12345-0@lo:502:llog_process_th.0 Request processed in 119us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.197747:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789607703.198102:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201656a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8477:1876539541062272:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789607703.198123:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607703.198129:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607703.198131:0:8477:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789607703.198134:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789607703.198216:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1789607703.198237:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789607703.198246:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.198257:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607703.198267:0:5845:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789607703.198269:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99a1c6588000 from 1 10000000:01000000:0.0:1789607703.198272:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789607703.198303:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001386079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.198311:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001386079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607703.198330:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001386079 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607703.198345:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541062400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789607703.198372:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607703.198405:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607703.198457:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541062400 00000100:00100000:2.0:1789607703.198461:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541062400 00000100:00100000:2.0:1789607703.198492:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789607703.198500:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541062400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607703.198510:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607703.198523:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c1510200/0x33f091d001386080 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001386079 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.198546:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c1510200/0x33f091d001386080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001386079 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.198556:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c1510200/0x33f091d001386080 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001386079 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607703.198565:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1510200, rc 0) 00000100:00100000:2.0:1789607703.198600:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541062400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607703.198606:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789607703.198790:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541062400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607703.198802:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001386079 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386080 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607703.198811:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001386079 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386080 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607703.198850:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541062528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607703.198872:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607703.198898:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff4bfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607703.198928:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541062528 00000100:00100000:3.0:1789607703.198932:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541062528 00000100:00100000:3.0:1789607703.198949:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789607703.198954:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541062528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607703.199177:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541062528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (304us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789607703.199184:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789607703.199300:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541062528:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789607703.199333:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789607703.199339:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001386079 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386080 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607703.199346:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001386079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386080 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607703.692203:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607703.692230:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541062656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607703.692303:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607703.692449:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541062656 00000100:00100000:0.0:1789607703.692457:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541062656 00000100:00100000:0.0:1789607703.692511:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789607703.692521:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541062656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607703.692575:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607703.692632:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541062656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607703.692650:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789607703.692870:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a201657480 x1876539541062656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607703.692898:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541062656:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789607703.947778:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607704.971621:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607705.228368:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541062784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607705.228494:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607705.228576:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541062784 00000100:00100000:3.0:1789607705.228585:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541062784 00000100:00100000:3.0:1789607705.228677:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789607705.228687:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541062784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607705.228723:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789607705.228929:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607705.230821:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4ac380 x1876539541062784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607705.230822:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541062784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1933us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607705.230845:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607705.230858:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541062784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607705.264949:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607705.265084:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520062336 00000100:00100000:0.0:1789607705.265098:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520062336 00000100:00100000:0.0:1789607705.265175:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 165 00000100:00100000:0.0:1789607705.265187:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:5616:x1876539520062336:12345-192.168.202.3@tcp:101: 00010000:00010000:0.0:1789607705.265206:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607705.265231:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103be00/0x33f091d001386087 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b94bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607705.265279:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103be00/0x33f091d001386087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94bb expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607705.265290:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103be00/0x33f091d001386087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94bb expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607705.265299:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103be00, rc 0) 00000100:00100000:0.0:1789607705.265381:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:5616:x1876539520062336:12345-192.168.202.3@tcp:101: Request processed in 197us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607705.265389:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 165 00000100:00100000:1.0:1789607705.271379:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607705.271538:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520062464 00000100:00100000:2.0:1789607705.271550:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520062464 00000100:00100000:2.0:1789607705.271618:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 166 00000100:00100000:2.0:1789607705.271630:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:5616:x1876539520062464:12345-192.168.202.3@tcp:501: 00000100:00100000:2.0:1789607705.272074:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:5616:x1876539520062464:12345-192.168.202.3@tcp:501: Request processed in 441us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607705.272082:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 166 00000100:00100000:1.0:1789607705.280354:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607705.280506:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520062592 00000100:00100000:3.0:1789607705.280517:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520062592 00000100:00100000:3.0:1789607705.280584:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 167 00000100:00100000:3.0:1789607705.280595:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:5616:x1876539520062592:12345-192.168.202.3@tcp:503: 00000100:00100000:3.0:1789607705.281285:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:5616:x1876539520062592:12345-192.168.202.3@tcp:503: Request processed in 688us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607705.281294:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 167 00000100:00100000:3.0:1789607705.290591:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607705.290707:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520062720 00000100:00100000:0.0:1789607705.290739:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520062720 00000100:00100000:0.0:1789607705.291356:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 168 00000100:00100000:0.0:1789607705.291369:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:6101:x1876539520062720:12345-192.168.202.3@tcp:502: 00000100:00100000:0.0:1789607705.291661:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:6101:x1876539520062720:12345-192.168.202.3@tcp:502: Request processed in 295us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607705.291670:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 168 00000100:00100000:1.0:1789607705.302639:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607705.302966:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520062848 00000100:00100000:2.0:1789607705.302976:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520062848 00000100:00100000:2.0:1789607705.303064:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 169 00000100:00100000:2.0:1789607705.303074:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:6101:x1876539520062848:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607705.303347:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:6101:x1876539520062848:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 273us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607705.303356:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 169 00000100:00100000:1.0:1789607705.308389:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607705.308510:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520062976 00000100:00100000:3.0:1789607705.308520:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520062976 00000100:00100000:3.0:1789607705.308577:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 170 00000100:00100000:3.0:1789607705.308587:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:5616:x1876539520062976:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607705.308604:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607705.308622:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558e600/0x33f091d00138608e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b94c2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607705.308665:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558e600/0x33f091d00138608e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94c2 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607705.308677:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558e600/0x33f091d00138608e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94c2 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607705.308687:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e600, rc 0) 00000100:00100000:3.0:1789607705.308761:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5616:x1876539520062976:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 175us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607705.308775:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 170 00000100:00100000:3.0:1789607705.312687:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607705.312793:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520063104 00000100:00100000:0.0:1789607705.312803:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520063104 00000100:00100000:0.0:1789607705.312856:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 171 00000100:00100000:0.0:1789607705.312864:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5616:x1876539520063104:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607705.313148:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5616:x1876539520063104:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 283us (471us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789607705.313156:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 171 00010000:00010000:3.0:1789607705.995598:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607707.030791:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789607707.185640:0:8515:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff630e02c0 20000000:00000080:2.0:1789607707.185659:0:8515:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a1ff530400 uarg=0000000000000000 20000000:01000000:2.0:1789607707.185697:0:8515:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789607707.185703:0:8515:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789607707.185707:0:8515:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789607707.187658:0:8516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789607707.190299:0:8515:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789607707.201535:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789607707.201680:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789607707.201737:0:8515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789607707.201755:0:8515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789607707.201774:0:8515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607707.201792:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d103a400/0x33f091d001385e0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385e03 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607707.201799:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1c1511600/0x33f091d001385e6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385e65 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607707.201805:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d8d7e800/0x33f091d001385f37 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001385f30 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607707.201826:0:8515:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1c1510800/0x33f091d001385ff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b948a expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607707.201834:0:8515:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607707.201874:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1c1510800/0x33f091d001385ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b948a expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607707.201889:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1c1510800/0x33f091d001385ff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b948a expref: 9 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607707.201905:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876539541062912:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607707.202256:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d8d7e800/0x33f091d001385f37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385f30 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607707.202264:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d8d7e800/0x33f091d001385f37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385f30 expref: 18 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607707.202274:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876539541063040:0@lo:104: 00000100:00100000:3.0:1789607707.202314:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607707.202355:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1c1511600/0x33f091d001385e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385e65 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607707.202364:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1c1511600/0x33f091d001385e6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385e65 expref: 18 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607707.202375:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876539541063168:0@lo:104: 00000100:00100000:2.0:1789607707.202388:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541063040 00000100:00100000:2.0:1789607707.202396:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541063040 00000100:00100000:3.0:1789607707.202413:0:8515:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607707.202475:0:8515:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d103a400/0x33f091d001385e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001385e03 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607707.202485:0:8515:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d103a400/0x33f091d001385e0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001385e03 expref: 18 pid: 5841 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607707.202493:0:8515:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876539541063296:0@lo:104: 00000100:00100000:2.0:1789607707.202508:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789607707.202524:0:8515:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607707.202530:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607707.202542:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541063168 00000100:00100000:2.0:1789607707.202544:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541063168 00000100:00100000:2.0:1789607707.202555:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541063296 00000100:00100000:2.0:1789607707.202556:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541063296 00000100:00100000:2.0:1789607707.202564:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607707.202571:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:8515:x1876539541063040:12345-0@lo:104: 00010000:00010000:2.0:1789607707.202582:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385f37 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202626:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789607707.202630:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:8515:x1876539541063040:12345-0@lo:104: Request processed in 60us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607707.202634:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607707.202647:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789607707.202656:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:8515:x1876539541063168:12345-0@lo:104: 00010000:00010000:2.0:1789607707.202661:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385e6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202684:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789607707.202687:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:8515:x1876539541063168:12345-0@lo:104: Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607707.202690:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789607707.202710:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789607707.202713:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:8515:x1876539541063296:12345-0@lo:104: 00010000:00010000:2.0:1789607707.202728:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c167d800/0x33f091d001385e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385e0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202744:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789607707.202747:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:8515:x1876539541063296:12345-0@lo:104: Request processed in 34us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607707.202750:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789607707.202762:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789607707.202766:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385f37 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202771:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d8d7e400 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607707.202774:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385f37 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202780:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385f37 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607707.202785:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385f37 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607707.202794:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607707.202825:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f37 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202829:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607707.202842:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f37 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202847:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7e400/0x33f091d001385f30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385f37 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202855:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607707.202857:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385e6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202860:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1510600 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607707.202862:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385e6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202866:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385e6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607707.202870:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385e6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607707.202883:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607707.202895:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385e6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202900:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607707.202923:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385e6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202929:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c1510600/0x33f091d001385e65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385e6c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202938:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607707.202941:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c167d800/0x33f091d001385e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001385e0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202946:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c167d800 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607707.202949:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167d800/0x33f091d001385e03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001385e0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202956:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c167d800/0x33f091d001385e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001385e0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607707.202962:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167d800/0x33f091d001385e03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001385e0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607707.202967:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607707.202980:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c167d800/0x33f091d001385e03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385e0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.202996:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607707.203002:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c167d800/0x33f091d001385e03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385e0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.203009:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c167d800/0x33f091d001385e03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001385e0a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.203025:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607707.203043:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607707.203046:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607707.203052:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607707.203067:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541063552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607707.203069:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876539541063040:0@lo:104: 00000100:00100000:3.0:1789607707.203083:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876539541063168:0@lo:104: 00000100:00100000:3.0:1789607707.203093:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876539541063296:0@lo:104: 00000100:00100000:2.0:1789607707.203112:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607707.203130:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607707.203135:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541063680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607707.203143:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541063552 00000100:00100000:3.0:1789607707.203150:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541063552 00000100:00100000:2.0:1789607707.203162:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789607707.203173:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1c1511600/0x33f091d001385e6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385e65 expref: 19 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607707.203200:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541063680 00000100:00100000:3.0:1789607707.203203:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541063680 00000100:00100000:2.0:1789607707.203210:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789607707.203216:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d103a400/0x33f091d001385e0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385e03 expref: 20 pid: 5841 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607707.203220:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+20:3309:x1876539541063552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607707.203234:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789607707.203239:0:5834:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1789607707.203240:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1c1511600/0x33f091d001385e6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385e65 expref: 20 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607707.203250:0:5834:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789607707.203252:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1c1511600/0x33f091d001385e6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385e65 expref: 20 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.203264:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c1511600/0x33f091d001385e6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385e65 expref: 20 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.203274:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607707.203300:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541063552:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607707.203304:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789607707.203315:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789607707.203318:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff819880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:3309:x1876539541063680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607707.203323:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607707.203326:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d103a400/0x33f091d001385e0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385e03 expref: 18 pid: 5841 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.203335:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d103a400/0x33f091d001385e0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385e03 expref: 18 pid: 5841 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.203342:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103a400/0x33f091d001385e0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385e03 expref: 18 pid: 5841 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.203348:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607707.203362:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff819880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:3309:x1876539541063680:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607707.203366:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789607707.205494:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607707.205519:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541063424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607707.205572:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607707.205613:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541063424 00000100:00100000:2.0:1789607707.205619:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541063424 00010000:00010000:2.0:1789607707.205648:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d8d7e800/0x33f091d001385f37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385f30 expref: 17 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607707.205666:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789607707.205672:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff818a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:3311:x1876539541063424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607707.205682:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607707.205686:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d8d7e800/0x33f091d001385f37 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001385f30 expref: 17 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.205693:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d8d7e800/0x33f091d001385f37 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001385f30 expref: 17 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.205705:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d8d7e800/0x33f091d001385f37 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001385f30 expref: 17 pid: 5839 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.205740:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607707.205764:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff818a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:3311:x1876539541063424:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607707.205769:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789607707.205797:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541063424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607707.206698:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541063680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607707.206711:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541063552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607707.217559:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607707.217590:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520063232 00000100:00100000:1.0:1789607707.217592:0:8515:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8515:1876539541062912:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607707.217599:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520063232 00010000:00010000:1.0:1789607707.217636:0:8515:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.217639:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1c1510800/0x33f091d001385ff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b948a expref: 10 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607707.217679:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:2.0:1789607707.217688:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff818700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2373:x1876539520063232:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607707.217702:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607707.217708:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1c1510800/0x33f091d001385ff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b948a expref: 10 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.217734:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1c1510800/0x33f091d001385ff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b948a expref: 10 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.217752:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c1510800/0x33f091d001385ff4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b948a expref: 10 pid: 5841 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.217768:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.217776:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.217814:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.217822:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.217829:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.217837:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.217844:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607707.217848:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.217856:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607707.218392:0:5830:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:2.0:1789607707.219181:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607707.219199:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607707.219258:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff818700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:2373:x1876539520063232:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1569us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607707.219266:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 24 00010000:00010000:1.0:1789607707.224993:0:8515:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607707.225018:0:8515:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607707.225027:0:8515:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1f558f400/0x33f091d001386095 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607707.442813:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607707.442855:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607707.442885:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607707.442912:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607707.442954:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520063488 00000100:00100000:1.0:1789607707.442963:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520063488 00000100:00100000:1.0:1789607707.443027:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:1.0:1789607707.443050:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffaffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520063488:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607707.443148:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffaffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520063488:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 101us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607707.443156:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:1.0:1789607707.443183:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520063616 00000100:00100000:1.0:1789607707.443188:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520063616 00000100:00100000:1.0:1789607707.443211:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520063744 00000100:00100000:1.0:1789607707.443214:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520063744 00000100:00100000:1.0:1789607707.443231:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:1.0:1789607707.443237:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520063616:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607707.443263:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520063616:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607707.443268:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:1.0:1789607707.443279:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:1.0:1789607707.443284:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520063744:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607707.443302:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520063744:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 18us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607707.443307:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00080000:1.0:1789607707.443333:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789607707.443337:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789607707.443339:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607707.443662:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520063360 00000100:00100000:3.0:1789607707.443667:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520063360 00000100:00100000:3.0:1789607707.443703:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 172 00000100:00100000:3.0:1789607707.443716:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:2376:x1876539520063360:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607707.443748:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:2376:x1876539520063360:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 34us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607707.443754:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 172 00010000:00010000:2.0:1789607708.043775:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789607708.300236:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789607708.300248:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1e8ccd800 from 4 10000000:01000000:1.0:1789607708.300255:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789607708.300319:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.300335:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.300369:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607708.300406:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541063808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.300593:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607708.300677:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db3900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607708.300832:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607708.300849:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541063936:0@lo:400:kworker.0 00000100:00100000:2.0:1789607708.300886:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607708.300944:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541064064:0@lo:400:kworker.0 00000100:00100000:2.0:1789607708.300970:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607708.301004:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541063936 00000100:00100000:2.0:1789607708.301013:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541063936 00000100:00100000:2.0:1789607708.301075:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541064064 00000100:00100000:2.0:1789607708.301079:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541064064 00000100:00100000:2.0:1789607708.301109:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789607708.301118:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541063936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607708.301177:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541063936:12345-0@lo:400:kworker.0 Request processed in 59us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607708.301185:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789607708.301203:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607708.301209:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541064064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607708.301234:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541064064:12345-0@lo:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607708.301240:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607708.301277:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541064064:0@lo:400:kworker.0 00000100:00100000:2.0:1789607708.301287:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541063936:0@lo:400:kworker.0 00000100:00100000:2.0:1789607708.301343:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607708.301351:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541064192:0@lo:400:kworker.0 00000100:00100000:2.0:1789607708.301382:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607708.301445:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607708.301456:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541064320:0@lo:400:kworker.0 00000100:00100000:2.0:1789607708.301465:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607708.301470:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541064448:0@lo:400:kworker.0 00000100:00100000:2.0:1789607708.301493:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607708.301494:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607708.301516:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541064320 00000100:00100000:3.0:1789607708.301519:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541064320 00000100:00100000:3.0:1789607708.301543:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607708.301549:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541064320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607708.301590:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541064320:12345-0@lo:400:kworker.0 Request processed in 41us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607708.301596:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1789607708.301686:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607708.301704:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541064192 00000100:00100000:1.0:1789607708.301708:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541064192 00000100:00100000:1.0:1789607708.301742:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541064448 00000100:00100000:1.0:1789607708.301744:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541064448 00000100:00100000:1.0:1789607708.301766:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607708.301773:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541064192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607708.301813:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541064192:12345-0@lo:400:kworker.0 Request processed in 42us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607708.301819:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607708.301833:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789607708.301838:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541064448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607708.301867:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541064448:12345-0@lo:400:kworker.0 Request processed in 29us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607708.301873:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789607708.301900:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789607708.301903:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789607708.301921:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff818000 x1876539541064192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607708.301933:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541064192:0@lo:400:kworker.0 00010000:00080000:1.0:1789607708.301967:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff81ad80 x1876539541064448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607708.301974:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541064448:0@lo:400:kworker.0 00000100:00100000:0.0:1789607708.302195:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541063808 00000100:00100000:0.0:1789607708.302202:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541063808 00000100:00100000:0.0:1789607708.302236:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1789607708.302244:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541063808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607708.302256:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607708.302280:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103b800/0x33f091d0013860a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d00138609c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607708.302310:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103b800/0x33f091d0013860a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d00138609c expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607708.302323:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103b800/0x33f091d0013860a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138609c expref: 17 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607708.302347:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b800, rc 0) 00000100:00100000:0.0:1789607708.302385:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541063808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607708.302390:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789607708.302569:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541063808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607708.302595:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013860a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.302606:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d0013860a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607708.302796:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541064320:0@lo:400:kworker.0 00000100:00100000:1.0:1789607708.302896:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541064576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.302933:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607708.303251:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db3900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607708.303337:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541064576 00000100:00100000:2.0:1789607708.303354:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541064576 00000100:00100000:2.0:1789607708.303392:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789607708.303399:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541064576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607708.304115:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541064576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 714us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607708.304125:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789607708.304220:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541064576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.304271:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541064704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.304325:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607708.304398:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db3900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607708.304524:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541064704 00000100:00100000:2.0:1789607708.304531:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541064704 00000100:00100000:1.0:1789607708.304755:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789607708.304765:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541064704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.305141:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541064704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 376us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607708.305149:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789607708.305252:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541064704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607708.305806:0:8542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8542:1876539541064832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607708.305858:0:8542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607708.305931:0:8542:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e020c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607708.306053:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541064832 00000100:00100000:1.0:1789607708.306066:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541064832 00000100:00100000:1.0:1789607708.306144:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789607708.306155:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:8542:x1876539541064832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607708.306370:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:8542:x1876539541064832:12345-0@lo:502:llog_process_th.0 Request processed in 216us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607708.306377:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789607708.306477:0:8542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8542:1876539541064832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607708.306511:0:8542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607708.306526:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607708.306529:0:8542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789607708.306538:0:8542:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a1e8ccd800 00000020:00000080:2.0:1789607708.306541:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789607708.306806:0:8542:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8542:1876539541064960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607708.306847:0:8542:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607708.306876:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541064960 00000100:00100000:2.0:1789607708.306881:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541064960 00000100:00100000:2.0:1789607708.306908:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789607708.306914:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:8542:x1876539541064960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607708.307322:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:8542:x1876539541064960:12345-0@lo:502:llog_process_th.0 Request processed in 405us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607708.307329:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789607708.307380:0:8542:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e020c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607708.307404:0:8542:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8542:1876539541064960:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607708.307815:0:8542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607708.307825:0:8542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607708.307827:0:8542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789607708.307834:0:8542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789607708.308040:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789607708.308067:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789607708.308081:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013860a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.308096:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013860a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607708.308108:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789607708.308111:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1c8d84800 from 4 10000000:01000000:1.0:1789607708.308114:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789607708.308152:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.308161:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.308172:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607708.308192:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541065088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.308241:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607708.308271:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db3780 going to sleep for 11 seconds 00000100:00100000:1.0:1789607708.308288:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541065088 00000100:00100000:1.0:1789607708.308302:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541065088 00000100:00100000:1.0:1789607708.308335:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789607708.308342:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541065088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607708.308354:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607708.308369:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c167d800/0x33f091d0013860b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d0013860aa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.308396:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c167d800/0x33f091d0013860b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d0013860aa expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.308408:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c167d800/0x33f091d0013860b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013860aa expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.308417:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c167d800, rc 0) 00000100:00100000:1.0:1789607708.308472:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541065088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607708.308478:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789607708.308517:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541065088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607708.308530:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013860b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.308541:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d0013860b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607708.308590:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541065216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.308615:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607708.308648:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db3780 going to sleep for 11 seconds 00000100:00100000:1.0:1789607708.308660:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541065216 00000100:00100000:1.0:1789607708.308673:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541065216 00000100:00100000:1.0:1789607708.308695:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789607708.308701:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541065216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.309520:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541065216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 816us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607708.309530:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789607708.310416:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541065216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607708.310801:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541065344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607708.310880:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607708.310964:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e020c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607708.311010:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541065344 00000100:00100000:1.0:1789607708.311018:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541065344 00000100:00100000:1.0:1789607708.311109:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789607708.311121:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541065344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.311353:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541065344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607708.311361:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789607708.311471:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541065344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607708.311698:0:8543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8543:1876539541065472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607708.311748:0:8543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607708.311769:0:8543:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e02840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607708.311977:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541065472 00000100:00100000:1.0:1789607708.311982:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541065472 00000100:00100000:1.0:1789607708.312062:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789607708.312072:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:8543:x1876539541065472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607708.312247:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:8543:x1876539541065472:12345-0@lo:502:llog_process_th.0 Request processed in 177us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607708.312255:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789607708.312321:0:8543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8543:1876539541065472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607708.312350:0:8543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607708.312361:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607708.312364:0:8543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789607708.312375:0:8543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a1c8d84800 00000020:00000080:2.0:1789607708.312378:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789607708.312475:0:8543:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8543:1876539541065600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607708.312508:0:8543:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607708.312527:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541065600 00000100:00100000:2.0:1789607708.312531:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541065600 00000100:00100000:2.0:1789607708.312548:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789607708.312554:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:8543:x1876539541065600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607708.312911:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:8543:x1876539541065600:12345-0@lo:502:llog_process_th.0 Request processed in 355us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607708.312919:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789607708.312961:0:8543:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c4f299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607708.312975:0:8543:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8543:1876539541065600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607708.312998:0:8543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607708.313002:0:8543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607708.313004:0:8543:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789607708.313008:0:8543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789607708.313228:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789607708.313254:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789607708.313266:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013860b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.313281:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013860b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607708.313304:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789607708.313307:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1c98a7800 from 4 10000000:01000000:1.0:1789607708.313311:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789607708.313342:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.313350:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.313360:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607708.313376:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541065728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.313412:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607708.313515:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db3780 going to sleep for 11 seconds 00000100:00100000:2.0:1789607708.313551:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541065728 00000100:00100000:2.0:1789607708.313557:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541065728 00000100:00100000:2.0:1789607708.313617:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789607708.313636:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541065728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607708.313650:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607708.313667:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c1510e00/0x33f091d0013860bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d0013860b8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607708.313696:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c1510e00/0x33f091d0013860bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d0013860b8 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607708.313709:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c1510e00/0x33f091d0013860bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013860b8 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607708.313728:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1510e00, rc 0) 00000100:00100000:2.0:1789607708.313773:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541065728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607708.313778:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789607708.315405:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541065728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607708.315469:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013860bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607708.315486:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d0013860bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607708.315589:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201656d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541065856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607708.315655:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607708.315708:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8ffd300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607708.318269:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541065856 00000100:00100000:1.0:1789607708.318295:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541065856 00000100:00100000:1.0:1789607708.318375:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789607708.318388:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541065856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.319236:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541065856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 843us (3572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607708.319250:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789607708.319503:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201656d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541065856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.319704:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541065984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607708.319806:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607708.319852:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789607708.319870:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541065984 00000100:00100000:0.0:1789607708.319880:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541065984 00000100:00100000:0.0:1789607708.319930:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789607708.319941:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541065984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607708.320371:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541065984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 431us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607708.320380:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789607708.320488:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541065984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607708.323295:0:8546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8546:1876539541066112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607708.323409:0:8546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607708.323490:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541066112 00000100:00100000:1.0:1789607708.323509:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541066112 00000100:00100000:2.0:1789607708.323528:0:8546:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e4e3c840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607708.323604:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789607708.323632:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:8546:x1876539541066112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607708.324252:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:8546:x1876539541066112:12345-0@lo:502:llog_process_th.0 Request processed in 633us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607708.324263:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789607708.324395:0:8546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8546:1876539541066112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607708.324510:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607708.326477:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607708.326485:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789607708.326501:0:8546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a1c98a7800 00000020:00000080:0.0:1789607708.326509:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789607708.326657:0:8546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8546:1876539541066240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607708.326764:0:8546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607708.326817:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541066240 00000100:00100000:0.0:1789607708.326825:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541066240 00000100:00100000:0.0:1789607708.326887:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789607708.326894:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:8546:x1876539541066240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607708.327176:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:8546:x1876539541066240:12345-0@lo:502:llog_process_th.0 Request processed in 281us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607708.327185:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789607708.329223:0:8546:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789607708.329278:0:8546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:8546:1876539541066240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789607708.329327:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789607708.329337:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607708.329340:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789607708.329344:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789607708.331002:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789607708.331094:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789607708.331110:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013860bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607708.331125:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013860bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607708.811696:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541066368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607708.811817:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607708.813568:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541066368 00000100:00100000:3.0:1789607708.813761:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541066368 00000100:00100000:3.0:1789607708.813826:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789607708.813836:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541066368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607708.813876:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607708.827129:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541066368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 13282us (15301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607708.827154:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789607708.842154:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffafc700 x1876539541066368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607708.842193:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541066368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789607709.074880:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607709.235317:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607709.235414:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520063872 00000100:00100000:1.0:1789607709.235458:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520063872 00000100:00100000:1.0:1789607709.235542:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 188 00000100:00100000:1.0:1789607709.235555:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+9:5616:x1876539520063872:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607709.235578:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607709.235603:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c167c800/0x33f091d0013860c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b94c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607709.235642:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c167c800/0x33f091d0013860c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94c9 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607709.235656:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c167c800/0x33f091d0013860c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94c9 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607709.235666:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c167c800, rc 0) 00000100:00100000:1.0:1789607709.235749:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5616:x1876539520063872:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 196us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607709.235756:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 188 00000100:00100000:1.0:1789607709.241010:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607709.241231:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520064000 00000100:00100000:2.0:1789607709.241245:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520064000 00000100:00100000:2.0:1789607709.241323:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 189 00000100:00100000:2.0:1789607709.241337:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5616:x1876539520064000:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607709.241812:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5616:x1876539520064000:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 476us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607709.241823:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 189 00000100:00100000:1.0:1789607709.260856:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607709.260948:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520064128 00000100:00100000:0.0:1789607709.260972:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520064128 00000100:00100000:0.0:1789607709.261070:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 190 00000100:00100000:0.0:1789607709.261083:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5616:x1876539520064128:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607709.261407:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:5616:x1876539520064128:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 325us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607709.261417:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 190 00000100:00100000:0.0:1789607709.298674:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607709.304522:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520064256 00000100:00100000:1.0:1789607709.304538:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520064256 00000100:00100000:1.0:1789607709.304616:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 191 00000100:00100000:1.0:1789607709.304628:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:6165:x1876539520064256:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789607709.304944:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:6165:x1876539520064256:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 317us (6289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607709.304969:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 191 00000100:00100000:1.0:1789607709.324317:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607709.324501:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520064384 00000100:00100000:3.0:1789607709.324515:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520064384 00000100:00100000:3.0:1789607709.324583:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 192 00000100:00100000:3.0:1789607709.324596:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:6165:x1876539520064384:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789607709.324975:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:6165:x1876539520064384:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 380us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607709.324984:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 192 00010000:00010000:2.0:1789607710.092114:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607710.348315:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607710.348350:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541066496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607710.348476:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607710.348543:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541066496 00000100:00100000:0.0:1789607710.348555:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541066496 00000100:00080000:1.0:1789607710.348621:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607710.348654:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789607710.348666:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541066496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607710.348720:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607710.348777:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541066496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607710.348782:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789607710.350157:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff819180 x1876539541066496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607710.350190:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541066496:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789607711.115840:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607712.139629:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607712.567590:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607712.567641:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607712.567678:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607712.567707:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607712.567744:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520064896 00000100:00100000:0.0:1789607712.567757:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520064896 00000100:00100000:0.0:1789607712.567831:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520064768 00000100:00100000:0.0:1789607712.567835:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520064768 00000100:00100000:0.0:1789607712.567862:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:0.0:1789607712.567874:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520064896:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607712.567964:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520064896:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 92us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607712.567973:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:0.0:1789607712.568005:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:0.0:1789607712.568011:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520064768:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607712.568036:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520064768:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607712.568043:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00080000:0.0:1789607712.568063:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607712.568067:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607712.568232:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520064640 00000100:00100000:3.0:1789607712.568237:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520064640 00000100:00100000:3.0:1789607712.568394:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:3.0:1789607712.568403:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2375:x1876539520064640:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607712.568457:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201657b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2375:x1876539520064640:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 55us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607712.568463:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:3.0:1789607712.568507:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520064512 00000100:00100000:3.0:1789607712.568511:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520064512 00000100:00100000:3.0:1789607712.568535:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 193 00000100:00100000:3.0:1789607712.568542:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2375:x1876539520064512:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607712.568568:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2375:x1876539520064512:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 26us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607712.568575:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 193 00000100:00080000:0.0:1789607712.568711:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789607713.177493:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607713.419961:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541066752:0@lo:400:kworker.0 00000100:00100000:1.0:1789607713.420050:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607713.420118:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541067264:0@lo:400:kworker.0 00000100:00100000:1.0:1789607713.420145:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607713.420180:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607713.420197:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541066880:0@lo:400:kworker.0 00000100:00100000:1.0:1789607713.420223:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607713.420254:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541066752 00000100:00100000:1.0:1789607713.420262:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541066752 00000100:00100000:1.0:1789607713.420301:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541066880 00000100:00100000:1.0:1789607713.420304:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541066880 00000100:00100000:1.0:1789607713.420334:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607713.420342:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541066752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607713.420396:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541066752:12345-0@lo:400:kworker.0 Request processed in 53us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607713.420403:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607713.420452:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789607713.420460:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541066880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607713.420499:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541066880:12345-0@lo:400:kworker.0 Request processed in 40us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607713.420505:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789607713.420526:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541067264 00000100:00100000:1.0:1789607713.420530:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541067264 00000100:00100000:1.0:1789607713.420559:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607713.420565:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541067264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607713.420595:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541067264:12345-0@lo:400:kworker.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607713.420600:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789607713.420623:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789607713.420627:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607713.420662:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541066880:0@lo:400:kworker.0 00000100:00100000:1.0:1789607713.420673:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541066752:0@lo:400:kworker.0 00010000:00080000:1.0:1789607713.420693:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffafea00 x1876539541067264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607713.420703:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541067264:0@lo:400:kworker.0 00000100:00100000:0.0:1789607713.420968:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541067008:0@lo:400:kworker.0 00000100:00100000:0.0:1789607713.421012:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607713.421043:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789607713.421049:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541066624:0@lo:400:kworker.0 00000100:00100000:0.0:1789607713.421075:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607713.421095:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541067136:0@lo:400:kworker.0 00000100:00100000:0.0:1789607713.421116:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607713.421234:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541067008 00000100:00100000:1.0:1789607713.421239:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541067008 00000100:00100000:1.0:1789607713.421283:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607713.421289:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541067008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607713.421329:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201656680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541067008:12345-0@lo:400:kworker.0 Request processed in 40us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607713.421335:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607713.421353:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541066624 00000100:00100000:1.0:1789607713.421357:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541066624 00000100:00100000:1.0:1789607713.421381:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789607713.421388:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541066624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607713.421442:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541066624:12345-0@lo:400:kworker.0 Request processed in 34us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607713.421448:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789607713.422714:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541066624:0@lo:400:kworker.0 00010000:00080000:1.0:1789607713.422734:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffafe680 x1876539541067008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607713.422746:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541067008:0@lo:400:kworker.0 00000100:00100000:1.0:1789607713.422773:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541067136 00000100:00100000:1.0:1789607713.422778:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541067136 00000100:00100000:1.0:1789607713.422819:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607713.422827:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541067136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607713.422892:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201656300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541067136:12345-0@lo:400:kworker.0 Request processed in 66us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607713.422899:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607713.422933:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541067136:0@lo:400:kworker.0 00000100:00080000:0.0:1789607713.424195:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607713.424203:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607713.932238:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541067392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607713.932314:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607713.932409:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541067392 00000100:00100000:2.0:1789607713.932417:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541067392 00000100:00100000:2.0:1789607713.932493:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789607713.932503:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541067392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607713.932564:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607713.933124:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541067392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 622us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607713.933132:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789607713.933204:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffad6300 x1876539541067392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607713.933225:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541067392:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789607714.188072:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789607714.241076:0:8814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1789607715.211910:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607715.471534:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607715.478336:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541067520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607715.478459:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607715.478942:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541067520 00000100:00100000:3.0:1789607715.478967:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541067520 00000100:00100000:3.0:1789607715.479069:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789607715.479081:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541067520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607715.479134:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607715.479213:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201657100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541067520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607715.479238:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789607715.479294:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff818380 x1876539541067520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607715.479316:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541067520:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607715.480273:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789607716.236626:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607717.264916:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607717.706387:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607717.706552:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607717.706584:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607717.706616:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607717.706783:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520065280 00000100:00100000:2.0:1789607717.706797:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520065280 00000100:00100000:2.0:1789607717.706888:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520065408 00000100:00100000:2.0:1789607717.706892:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520065408 00000100:00100000:2.0:1789607717.706925:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1789607717.706950:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2372:x1876539520065280:12345-192.168.202.3@tcp:9:kworker.0 00000020:00000080:2.0:1789607717.707014:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001386002 00000100:00080000:2.0:1789607717.707029:0:6695:0:(import.c:65:import_set_state_nolock()) ffff99a0c1ce1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789607717.707085:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789607717.707591:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+2:2372:x1876539520065280:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 654us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607717.707602:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1789607717.707627:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:2.0:1789607717.707636:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2372:x1876539520065408:12345-192.168.202.3@tcp:9:kworker.0 00000020:00000080:2.0:1789607717.707657:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001386009 00000100:00080000:2.0:1789607717.707665:0:6695:0:(import.c:65:import_set_state_nolock()) ffff99a0c1ce7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789607717.707692:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789607717.707898:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+2:2372:x1876539520065408:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 263us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607717.707906:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00080000:2.0:1789607717.707952:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607717.707977:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789607717.708062:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607717.708212:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607717.711031:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520065152 00000100:00100000:2.0:1789607717.711052:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520065152 00000100:00100000:2.0:1789607717.711166:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:2.0:1789607717.711179:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520065152:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607717.711289:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520065152:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 112us (4670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607717.711297:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00080000:2.0:1789607717.711482:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607717.715006:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520065024 00000100:00100000:1.0:1789607717.715023:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520065024 00000100:00100000:1.0:1789607717.715137:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 195 00000100:00100000:1.0:1789607717.715148:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2376:x1876539520065024:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607717.715232:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2376:x1876539520065024:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 85us (8864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607717.715240:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 195 00000001:00100000:3.0:1789607718.088983:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000020:00000080:3.0:1789607718.088997:0:6718:0:(genops.c:885:class_export_put()) final put ffff99a0c1ce6000/d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000020:00000080:0.0:1789607718.089198:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a0c1ce6000/d0d9aceb-01dc-4deb-add2-cd492a0443a6 for lustre-OST0000 00000020:00000080:0.0:1789607718.089263:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a0c1ce1800 for lustre-OST0000 00010000:00010000:2.0:1789607718.285177:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607718.540484:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541067648:0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.540593:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607718.540652:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541068160:0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.540683:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607718.540712:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607718.540718:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541068032:0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.540758:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607718.540789:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541067776:0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.540816:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607718.540833:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541068288:0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.540857:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607718.540879:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607718.540885:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541067904:0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.540915:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607718.540970:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541068032 00000100:00100000:3.0:1789607718.540979:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541068032 00000100:00100000:3.0:1789607718.541048:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541068288 00000100:00100000:3.0:1789607718.541052:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541068288 00000100:00100000:3.0:1789607718.541082:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789607718.541105:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541068032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.541174:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541068032:12345-0@lo:400:kworker.0 Request processed in 85us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607718.541183:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789607718.541203:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789607718.541210:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541068288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.541241:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541068288:12345-0@lo:400:kworker.0 Request processed in 32us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607718.541247:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789607718.541271:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541068160 00000100:00100000:3.0:1789607718.541274:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541068160 00000100:00100000:3.0:1789607718.541296:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541067776 00000100:00100000:3.0:1789607718.541299:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541067776 00000100:00100000:3.0:1789607718.541309:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541067904 00000100:00100000:3.0:1789607718.541311:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541067904 00000100:00100000:3.0:1789607718.541323:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607718.541329:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541068160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.541358:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541068160:12345-0@lo:400:kworker.0 Request processed in 30us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607718.541364:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607718.541375:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607718.541380:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541067776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.541407:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541067776:12345-0@lo:400:kworker.0 Request processed in 27us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607718.541419:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607718.541459:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607718.541465:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541067904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607718.541749:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541067648 00000100:00100000:0.0:1789607718.541755:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541067648 00000100:00100000:0.0:1789607718.541790:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789607718.541797:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541067648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607718.542261:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541067648:12345-0@lo:400:kworker.0 Request processed in 462us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607718.542269:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789607718.542350:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541067904:12345-0@lo:400:kworker.0 Request processed in 884us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607718.542357:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1789607718.542380:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607718.542387:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607718.542390:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607718.542539:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541067904:0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.542556:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541067776:0@lo:400:kworker.0 00010000:00080000:3.0:1789607718.542572:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a201655c00 x1876539541068288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607718.542585:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541068288:0@lo:400:kworker.0 00010000:00080000:3.0:1789607718.542632:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a201656a00 x1876539541068032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607718.542642:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201656a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541068032:0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.542653:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201656d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541067648:0@lo:400:kworker.0 00000100:00100000:3.0:1789607718.542665:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541068160:0@lo:400:kworker.0 00000100:00100000:1.0:1789607719.056010:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541068416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607719.056121:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607719.056226:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541068416 00000100:00100000:1.0:1789607719.056237:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541068416 00000100:00100000:1.0:1789607719.056300:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607719.056310:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541068416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607719.056360:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607719.056415:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541068416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607719.056468:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789607719.056525:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee292d80 x1876539541068416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607719.056549:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541068416:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789607719.316047:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607720.343404:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607720.592238:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541068544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607720.592324:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607720.596729:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541068544 00000100:00100000:0.0:1789607720.596743:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541068544 00000100:00100000:0.0:1789607720.596849:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789607720.596860:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541068544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607720.596899:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789607720.597036:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607720.608086:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541068544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11217us (15750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607720.608102:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1789607720.609948:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff81b480 x1876539541068544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607720.609980:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541068544:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789607721.205991:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000020:00000080:3.0:1789607721.206003:0:7651:0:(genops.c:885:class_export_put()) final put ffff99a0c1ce5000/d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000020:00000080:0.0:1789607721.213093:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a0c1ce5000/d0d9aceb-01dc-4deb-add2-cd492a0443a6 for lustre-OST0001 00000020:00000080:1.0:1789607721.221120:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a0c1ce7800 for lustre-OST0001 00010000:00010000:0.0:1789607721.356453:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789607722.176299:0:9062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing yml_node 00010000:00010000:0.0:1789607722.387779:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607722.804420:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607722.804482:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607722.804521:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520065664 00000100:00100000:1.0:1789607722.804531:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520065664 00000100:00100000:1.0:1789607722.804592:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:1.0:1789607722.804602:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520065664:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607722.804677:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520065664:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 76us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607722.804684:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00080000:1.0:1789607722.804717:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607722.805500:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520065536 00000100:00100000:3.0:1789607722.805508:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520065536 00000100:00100000:3.0:1789607722.805585:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 197 00000100:00100000:3.0:1789607722.805594:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2376:x1876539520065536:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607722.805639:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2376:x1876539520065536:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 46us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607722.805646:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 197 00010000:00010000:0.0:1789607723.403637:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607723.660458:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541068928:0@lo:400:kworker.0 00000100:00100000:3.0:1789607723.660555:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607723.660617:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789607723.660624:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541068800:0@lo:400:kworker.0 00000100:00100000:3.0:1789607723.660648:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607723.660665:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541069312:0@lo:400:kworker.0 00000100:00100000:3.0:1789607723.660691:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607723.660727:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541068928 00000100:00100000:3.0:1789607723.660735:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541068928 00000100:00100000:3.0:1789607723.660795:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541068800 00000100:00100000:3.0:1789607723.660799:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541068800 00000100:00100000:3.0:1789607723.660822:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789607723.660831:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541068928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607723.660984:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541068928:12345-0@lo:400:kworker.0 Request processed in 153us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607723.660992:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789607723.661011:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607723.661017:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541068800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607723.661042:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541068800:12345-0@lo:400:kworker.0 Request processed in 26us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607723.661060:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607723.661170:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541069312 00000100:00100000:3.0:1789607723.661174:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541069312 00000100:00100000:3.0:1789607723.661202:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789607723.661208:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541069312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607723.661239:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541069312:12345-0@lo:400:kworker.0 Request processed in 32us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607723.661245:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789607723.661260:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607723.661263:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607723.661298:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541068800:0@lo:400:kworker.0 00010000:00080000:3.0:1789607723.661311:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffad6d80 x1876539541069312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607723.661321:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541069312:0@lo:400:kworker.0 00000100:00100000:3.0:1789607723.661330:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541068928:0@lo:400:kworker.0 00000100:00100000:2.0:1789607723.661419:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541068672:0@lo:400:kworker.0 00000100:00100000:2.0:1789607723.661494:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607723.661520:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541069184:0@lo:400:kworker.0 00000100:00100000:2.0:1789607723.661541:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607723.661559:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607723.661564:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541069056:0@lo:400:kworker.0 00000100:00100000:2.0:1789607723.661584:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607723.661609:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541069056 00000100:00100000:2.0:1789607723.661613:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541069056 00000100:00100000:2.0:1789607723.661646:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607723.661653:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541069056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607723.661688:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541069056:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607723.661703:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1789607723.661720:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789607723.661736:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffad4380 x1876539541069056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607723.661746:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541069056:0@lo:400:kworker.0 00000100:00100000:2.0:1789607723.661762:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541069184 00000100:00100000:2.0:1789607723.661765:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541069184 00000100:00100000:2.0:1789607723.661792:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789607723.661798:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541069184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607723.661844:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541069184:12345-0@lo:400:kworker.0 Request processed in 46us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607723.661849:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789607723.661863:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607723.661887:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541069184:0@lo:400:kworker.0 00000100:00100000:0.0:1789607723.662045:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541068672 00000100:00100000:0.0:1789607723.662049:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541068672 00000100:00100000:0.0:1789607723.662089:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789607723.662096:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541068672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607723.662135:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541068672:12345-0@lo:400:kworker.0 Request processed in 40us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607723.662140:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789607723.662173:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541068672:0@lo:400:kworker.0 00000100:00100000:3.0:1789607724.171711:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541069440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607724.171788:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607724.173032:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541069440 00000100:00100000:2.0:1789607724.173042:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541069440 00000100:00100000:2.0:1789607724.173136:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789607724.173147:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541069440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607724.173185:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607724.173257:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541069440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607724.173265:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789607724.173336:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee291880 x1876539541069440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607740 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607724.173355:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541069440:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789607724.427901:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607725.451712:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607725.707784:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607725.707810:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541069568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607725.707956:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607725.708150:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541069568 00000100:00100000:2.0:1789607725.708158:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541069568 00000100:00080000:3.0:1789607725.708192:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607725.708212:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789607725.708301:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541069568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607725.708338:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607725.708387:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541069568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (431us total) trans 0 rc 0/0 00010000:00080000:1.0:1789607725.708461:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff818e00 x1876539541069568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607725.708488:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541069568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607725.713408:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789607726.477483:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607727.499820:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789607727.773009:0:9253:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:3.0:1789607727.923408:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607727.923489:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607727.923531:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520065920 00000100:00100000:3.0:1789607727.923550:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520065920 00000100:00100000:3.0:1789607727.923635:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:3.0:1789607727.923649:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2375:x1876539520065920:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607727.923774:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2375:x1876539520065920:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 129us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607727.923783:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:3.0:1789607727.923815:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520065792 00000100:00100000:3.0:1789607727.923819:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520065792 00000100:00100000:3.0:1789607727.923864:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 199 00000100:00100000:3.0:1789607727.923874:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2375:x1876539520065792:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607727.925055:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2375:x1876539520065792:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 1179us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607727.925064:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 199 00000100:00080000:3.0:1789607727.925116:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789607728.525643:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607728.787777:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541069952:0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.787886:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607728.787974:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789607728.787981:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541069824:0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.788007:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607728.788026:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541070336:0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.788083:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607728.788129:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541069952 00000100:00100000:2.0:1789607728.788139:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541069952 00000100:00100000:2.0:1789607728.788201:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541069824 00000100:00100000:2.0:1789607728.788205:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541069824 00000100:00100000:2.0:1789607728.788229:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789607728.788240:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541069952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.788303:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541069952:12345-0@lo:400:kworker.0 Request processed in 65us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607728.788309:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789607728.788327:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789607728.788334:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541069824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.788359:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541069824:12345-0@lo:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607728.788372:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789607728.788398:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541070336 00000100:00100000:2.0:1789607728.788403:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541070336 00000100:00100000:2.0:1789607728.788458:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607728.788465:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541070336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.788497:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541070336:12345-0@lo:400:kworker.0 Request processed in 33us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607728.788503:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789607728.788519:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607728.788524:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607728.788572:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541069824:0@lo:400:kworker.0 00010000:00080000:2.0:1789607728.788585:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff819180 x1876539541070336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607728.788596:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541070336:0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.788605:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541069952:0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.790866:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541070080:0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.790983:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607728.791108:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789607728.791117:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541069696:0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.791157:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607728.791197:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541070208:0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.791227:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607728.791470:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541069696 00000100:00100000:2.0:1789607728.791480:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541069696 00000100:00100000:2.0:1789607728.791571:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789607728.791581:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541069696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.791657:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541069696:12345-0@lo:400:kworker.0 Request processed in 64us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607728.791665:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789607728.791711:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541070208 00000100:00100000:2.0:1789607728.791715:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541070208 00000100:00100000:2.0:1789607728.791758:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789607728.791766:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541070208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.791801:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541070208:12345-0@lo:400:kworker.0 Request processed in 36us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607728.791807:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789607728.791841:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607728.791876:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541069696:0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.791891:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541070208:0@lo:400:kworker.0 00000100:00100000:3.0:1789607728.806792:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541070080 00000100:00100000:3.0:1789607728.806814:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541070080 00000100:00080000:3.0:1789607728.807857:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607728.807873:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789607728.807888:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541070080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607728.808040:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541070080:12345-0@lo:400:kworker.0 Request processed in 155us (17056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607728.808048:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789607728.808301:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff81b480 x1876539541070080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607728.808319:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541070080:0@lo:400:kworker.0 00000100:00100000:0.0:1789607729.292063:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607729.292098:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541070464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607729.292195:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607729.292348:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541070464 00000100:00100000:3.0:1789607729.292359:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541070464 00000100:00100000:3.0:1789607729.292471:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789607729.292483:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541070464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607729.292534:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607729.292601:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201657800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541070464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607729.292629:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789607729.293043:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee290a80 x1876539541070464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607745 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607729.293068:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541070464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789607729.547745:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607730.572868:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789607730.713554:0:9352:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:3.0:1789607730.830382:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541070592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607730.830530:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607730.830600:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541070592 00000100:00100000:2.0:1789607730.830613:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541070592 00000100:00100000:2.0:1789607730.830700:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789607730.830705:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607730.830711:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541070592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607730.830877:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607730.830971:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541070592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 261us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607730.830980:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789607730.831178:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4b9c00 x1876539541070592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607730.831201:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541070592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789607731.597043:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607732.624416:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607733.044913:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607733.044958:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607733.045002:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520066176 00000100:00100000:3.0:1789607733.045012:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520066176 00000100:00100000:3.0:1789607733.045076:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:3.0:1789607733.045086:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520066176:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607733.045160:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520066176:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 75us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607733.045167:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00080000:3.0:1789607733.045189:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607733.045532:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520066048 00000100:00100000:1.0:1789607733.045538:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520066048 00000100:00100000:1.0:1789607733.045572:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 201 00000100:00100000:1.0:1789607733.045580:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2373:x1876539520066048:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607733.045625:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2373:x1876539520066048:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 45us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607733.045632:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 201 00010000:00010000:2.0:1789607733.646451:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789607733.690014:0:9450:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:0.0:1789607733.899889:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541071104:0@lo:400:kworker.0 00000100:00100000:0.0:1789607733.899975:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607733.899998:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541070848:0@lo:400:kworker.0 00000100:00100000:3.0:1789607733.900030:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607733.900035:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789607733.900040:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541070720:0@lo:400:kworker.0 00000100:00100000:3.0:1789607733.900046:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541071360:0@lo:400:kworker.0 00000100:00100000:2.0:1789607733.900109:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541070976:0@lo:400:kworker.0 00000100:00100000:1.0:1789607733.900481:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541071104 00000100:00100000:1.0:1789607733.900489:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541071104 00000100:00100000:1.0:1789607733.900556:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789607733.900567:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541071104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607733.903145:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607733.903233:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607733.903264:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541071360 00000100:00100000:3.0:1789607733.903265:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541070848 00000100:00100000:3.0:1789607733.903273:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541070848 00000100:00100000:0.0:1789607733.903273:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541071360 00000100:00100000:3.0:1789607733.903321:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789607733.903321:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789607733.903331:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541070848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607733.903331:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541071360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607733.903402:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541071360:12345-0@lo:400:kworker.0 Request processed in 72us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607733.903409:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789607733.903443:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541070720 00000100:00100000:0.0:1789607733.903447:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541070720 00000100:00100000:0.0:1789607733.903469:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789607733.903475:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541070720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607733.903480:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607733.903629:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541070720:12345-0@lo:400:kworker.0 Request processed in 152us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607733.903635:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00080000:0.0:1789607733.903684:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c8d98a80 x1876539541071360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607733.903702:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541071360:0@lo:400:kworker.0 00000100:00100000:0.0:1789607733.903734:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541070720:0@lo:400:kworker.0 00000100:00100000:0.0:1789607733.903745:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541071232:0@lo:400:kworker.0 00000100:00100000:0.0:1789607733.903771:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607733.903887:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541070976 00000100:00100000:2.0:1789607733.903892:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541070976 00000100:00100000:2.0:1789607733.903911:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541071232 00000100:00100000:2.0:1789607733.903914:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541071232 00000100:00100000:2.0:1789607733.903928:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789607733.903933:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541070976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607733.903977:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541070976:12345-0@lo:400:kworker.0 Request processed in 44us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607733.903983:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789607733.903995:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789607733.904000:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541071232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607733.904026:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201656a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541071232:12345-0@lo:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607733.904031:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789607733.905364:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541070976:0@lo:400:kworker.0 00000100:00100000:0.0:1789607733.905408:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541071232:0@lo:400:kworker.0 00000100:00080000:2.0:1789607733.905630:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607733.905638:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607733.905641:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607733.907565:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541071104:12345-0@lo:400:kworker.0 Request processed in 6991us (7579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607733.907580:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789607733.907644:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffad6300 x1876539541071104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607733.907660:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541071104:0@lo:400:kworker.0 00000100:00100000:3.0:1789607733.908006:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541070848:12345-0@lo:400:kworker.0 Request processed in 4675us (7973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607733.908016:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789607733.908141:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541070848:0@lo:400:kworker.0 00000100:00100000:0.0:1789607734.411712:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541071488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607734.411816:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607734.412077:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541071488 00000100:00100000:2.0:1789607734.412087:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541071488 00000100:00100000:2.0:1789607734.412154:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607734.412164:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541071488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607734.412398:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607734.412498:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201655c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541071488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 335us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607734.412506:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789607734.412660:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee290a80 x1876539541071488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607734.412682:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541071488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789607734.668117:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789607735.478064:0:9498:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 16 21:15:33 EDT 2026 00010000:00010000:0.0:1789607735.699831:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607735.949477:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607735.949497:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541071616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607735.949569:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607735.949670:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541071616 00000100:00100000:2.0:1789607735.949676:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541071616 00000100:00100000:2.0:1789607735.949801:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789607735.949816:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541071616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607735.949854:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607735.949901:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541071616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607735.949908:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789607735.949929:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789607735.950350:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4baa00 x1876539541071616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607735.950371:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541071616:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789607736.715884:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607737.753691:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607738.164670:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607738.164727:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607738.164772:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520066432 00000100:00100000:0.0:1789607738.164782:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520066432 00000100:00100000:0.0:1789607738.164849:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:0.0:1789607738.164860:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2374:x1876539520066432:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607738.164935:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201657480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2374:x1876539520066432:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 77us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607738.164941:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:0.0:1789607738.164984:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520066304 00000100:00100000:0.0:1789607738.164988:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520066304 00000100:00100000:0.0:1789607738.165012:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 203 00000100:00100000:0.0:1789607738.165018:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2374:x1876539520066304:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607738.165045:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2374:x1876539520066304:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 27us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607738.165052:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 203 00000100:00080000:0.0:1789607738.165076:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789607738.766690:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607739.019814:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541072000:0@lo:400:kworker.0 00000100:00100000:3.0:1789607739.019894:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607739.020002:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541071872:0@lo:400:kworker.0 00000100:00100000:2.0:1789607739.020033:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607739.020082:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541072384:0@lo:400:kworker.0 00000100:00100000:2.0:1789607739.020109:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607739.020125:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541072128:0@lo:400:kworker.0 00000100:00100000:2.0:1789607739.020153:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541072384 00000100:00100000:0.0:1789607739.020153:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607739.020160:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541072384 00000100:00100000:0.0:1789607739.020173:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789607739.020178:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541071744:0@lo:400:kworker.0 00000100:00100000:0.0:1789607739.020204:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607739.020207:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541072128 00000100:00100000:2.0:1789607739.020210:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541072128 00000100:00100000:0.0:1789607739.020223:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541072256:0@lo:400:kworker.0 00000100:00100000:2.0:1789607739.020231:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789607739.020240:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541072384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607739.020263:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607739.020290:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607739.020291:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541072384:12345-0@lo:400:kworker.0 Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607739.020298:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789607739.020298:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541072128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607739.020329:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541072128:12345-0@lo:400:kworker.0 Request processed in 32us (175us total) trans 0 rc 0/0 00000100:00080000:2.0:1789607739.020334:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607739.020335:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789607739.020338:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607739.020350:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541071744 00000100:00100000:0.0:1789607739.020353:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541071744 00010000:00080000:2.0:1789607739.020363:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c8d98700 x1876539541072384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607739.020375:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789607739.020376:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541072384:0@lo:400:kworker.0 00000100:00100000:0.0:1789607739.020381:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541071744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607739.020407:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541071744:12345-0@lo:400:kworker.0 Request processed in 26us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607739.020413:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541072000 00000100:00100000:2.0:1789607739.020417:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541072000 00000100:00100000:0.0:1789607739.020440:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789607739.020471:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541071872 00000100:00100000:2.0:1789607739.020474:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541071872 00000100:00100000:1.0:1789607739.020546:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541071744:0@lo:400:kworker.0 00010000:00080000:1.0:1789607739.020556:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c8d99180 x1876539541072128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607739.020565:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541072128:0@lo:400:kworker.0 00000100:00100000:0.0:1789607739.020891:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541072256 00000100:00100000:0.0:1789607739.020896:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541072256 00000100:00100000:0.0:1789607739.020917:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789607739.023529:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541072000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607739.023649:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541072000:12345-0@lo:400:kworker.0 Request processed in 146us (3755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607739.024377:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789607739.024393:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541071872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607739.024467:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541071872:12345-0@lo:400:kworker.0 Request processed in 81us (4434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607739.024475:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789607739.024504:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789607739.024511:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541072256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607739.024551:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541072256:12345-0@lo:400:kworker.0 Request processed in 41us (4287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607739.024557:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1789607739.024599:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607739.024642:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541071872:0@lo:400:kworker.0 00000100:00100000:3.0:1789607739.024665:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541072000:0@lo:400:kworker.0 00000100:00100000:2.0:1789607739.024694:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541072256:0@lo:400:kworker.0 00000100:00100000:0.0:1789607739.027195:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789607739.531936:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607739.531963:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541072512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607739.532025:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607739.532141:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541072512 00000100:00100000:0.0:1789607739.532148:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541072512 00000100:00100000:0.0:1789607739.532190:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789607739.532196:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541072512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607739.532233:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607739.532281:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541072512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607739.532286:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789607739.532354:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee292680 x1876539541072512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607755 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607739.532386:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541072512:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789607739.787602:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607740.812610:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607741.074009:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541072640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607741.074096:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607741.074222:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541072640 00000100:00100000:0.0:1789607741.074232:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541072640 00000100:00100000:0.0:1789607741.074305:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789607741.074316:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541072640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607741.074357:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607741.074407:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541072640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607741.074414:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789607741.074578:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4b9180 x1876539541072640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607741.074598:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541072640:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789607741.074894:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789607741.840971:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607742.861017:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607743.288896:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607743.288948:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607743.289004:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520066688 00000100:00100000:3.0:1789607743.289018:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520066688 00000100:00100000:3.0:1789607743.289100:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:3.0:1789607743.289114:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520066688:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607743.289212:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520066688:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 101us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607743.289232:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00080000:3.0:1789607743.289259:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607743.289715:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520066560 00000100:00100000:1.0:1789607743.289722:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520066560 00000100:00100000:1.0:1789607743.289772:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 205 00000100:00100000:1.0:1789607743.289781:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2373:x1876539520066560:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607743.289831:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2373:x1876539520066560:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 51us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607743.289838:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 205 00010000:00010000:1.0:1789607743.883667:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607744.139708:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541073024:0@lo:400:kworker.0 00000100:00100000:3.0:1789607744.139788:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607744.139856:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789607744.139874:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541072896:0@lo:400:kworker.0 00000100:00100000:3.0:1789607744.139909:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607744.139927:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541073408:0@lo:400:kworker.0 00000100:00100000:3.0:1789607744.139955:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607744.140067:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541073024 00000100:00100000:3.0:1789607744.140075:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541073024 00000100:00100000:3.0:1789607744.140131:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541072896 00000100:00100000:3.0:1789607744.140133:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541072896 00000100:00100000:3.0:1789607744.140148:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789607744.140155:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541073024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607744.140203:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541073024:12345-0@lo:400:kworker.0 Request processed in 49us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607744.140209:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789607744.140223:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789607744.140226:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541072896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607744.140244:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541072896:12345-0@lo:400:kworker.0 Request processed in 18us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607744.140248:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789607744.140262:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607744.140296:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541072896:0@lo:400:kworker.0 00000100:00100000:3.0:1789607744.140304:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541073024:0@lo:400:kworker.0 00000100:00100000:1.0:1789607744.140453:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541072768:0@lo:400:kworker.0 00000100:00100000:1.0:1789607744.140494:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607744.140526:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541073280:0@lo:400:kworker.0 00000100:00100000:1.0:1789607744.140550:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607744.140570:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607744.140575:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541073152:0@lo:400:kworker.0 00000100:00100000:1.0:1789607744.140594:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607744.140615:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541073280 00000100:00100000:1.0:1789607744.140618:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541073280 00000100:00100000:1.0:1789607744.140644:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789607744.140648:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541073280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607744.140673:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541073280:12345-0@lo:400:kworker.0 Request processed in 24us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607744.140676:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789607744.140708:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541073408 00000100:00100000:1.0:1789607744.140712:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541073408 00000100:00100000:1.0:1789607744.140744:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541073152 00000100:00100000:1.0:1789607744.140748:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541073152 00000100:00080000:0.0:1789607744.140841:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607744.140853:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607744.140855:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607744.140964:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541072768 00000100:00100000:3.0:1789607744.140969:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541072768 00000100:00100000:3.0:1789607744.141694:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789607744.141708:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541072768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607744.141774:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541072768:12345-0@lo:400:kworker.0 Request processed in 71us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607744.141793:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789607744.142165:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789607744.142180:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541073408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607744.142237:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541073408:12345-0@lo:400:kworker.0 Request processed in 62us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607744.142244:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789607744.142262:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789607744.142270:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541073152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607744.142301:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541073152:12345-0@lo:400:kworker.0 Request processed in 33us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607744.142307:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789607744.142372:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c9d36300 x1876539541073408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607744.142390:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541073408:0@lo:400:kworker.0 00010000:00080000:2.0:1789607744.143549:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c8d9b100 x1876539541073152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607744.143567:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541073152:0@lo:400:kworker.0 00000100:00100000:2.0:1789607744.143581:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541072768:0@lo:400:kworker.0 00000100:00100000:2.0:1789607744.143596:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541073280:0@lo:400:kworker.0 00000100:00100000:2.0:1789607744.651636:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607744.651671:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541073536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607744.651777:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607744.651905:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541073536 00000100:00100000:1.0:1789607744.651916:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541073536 00000100:00100000:1.0:1789607744.652022:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789607744.652034:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541073536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607744.652082:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607744.652158:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541073536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607744.652166:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1789607744.652688:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee290a80 x1876539541073536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607760 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607744.652711:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541073536:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789607744.911748:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607745.952482:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607746.196187:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607746.196222:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541073664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607746.196317:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607746.196462:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541073664 00000100:00100000:2.0:1789607746.196473:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541073664 00000100:00100000:2.0:1789607746.196556:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789607746.196568:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541073664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607746.196621:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607746.196692:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541073664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607746.196699:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789607746.196743:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4bb480 x1876539541073664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607746.196762:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541073664:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607746.196831:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789607746.955782:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607747.980802:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607748.402779:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607748.405575:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607748.406020:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520066944 00000100:00100000:1.0:1789607748.406032:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520066944 00000100:00100000:1.0:1789607748.406119:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 65 00000100:00100000:1.0:1789607748.406130:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520066944:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607748.406219:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520066944:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 89us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607748.406227:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 65 00000100:00080000:3.0:1789607748.406548:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607748.406684:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520066816 00000100:00100000:0.0:1789607748.406691:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520066816 00000100:00100000:0.0:1789607748.406756:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 207 00000100:00100000:0.0:1789607748.406763:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2373:x1876539520066816:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607748.406794:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2373:x1876539520066816:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 33us (4029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607748.406800:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 207 00010000:00010000:3.0:1789607749.012604:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607749.265502:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541073792:0@lo:400:kworker.0 00000100:00100000:3.0:1789607749.265591:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541074176:0@lo:400:kworker.0 00000100:00100000:0.0:1789607749.265669:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541073920:0@lo:400:kworker.0 00000100:00100000:3.0:1789607749.269854:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607749.269966:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607749.269982:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541074304:0@lo:400:kworker.0 00000100:00100000:3.0:1789607749.270028:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607749.270084:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541074048:0@lo:400:kworker.0 00000100:00100000:3.0:1789607749.270110:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607749.270150:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541074176 00000100:00100000:3.0:1789607749.270160:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541074176 00000100:00100000:3.0:1789607749.270234:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607749.270244:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541074176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607749.270313:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541074176:12345-0@lo:400:kworker.0 Request processed in 71us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607749.270321:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607749.270357:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541074304 00000100:00100000:3.0:1789607749.270361:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541074304 00000100:00100000:3.0:1789607749.270391:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541074048 00000100:00100000:3.0:1789607749.270393:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541074048 00000100:00100000:3.0:1789607749.270414:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789607749.273560:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541074304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607749.273733:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541074304:12345-0@lo:400:kworker.0 Request processed in 3308us (3699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607749.273774:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789607749.273830:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789607749.273843:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541074048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607749.273900:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541074048:12345-0@lo:400:kworker.0 Request processed in 63us (3789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607749.273906:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789607749.273939:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607749.273947:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607749.274015:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541074048:0@lo:400:kworker.0 00000100:00100000:3.0:1789607749.274067:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541074304:0@lo:400:kworker.0 00010000:00080000:3.0:1789607749.274083:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffafe680 x1876539541074176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607749.274096:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541074176:0@lo:400:kworker.0 00000100:00100000:2.0:1789607749.275446:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607749.275544:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541073792 00000100:00100000:2.0:1789607749.275555:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541073792 00000100:00100000:2.0:1789607749.275624:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789607749.276286:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541073792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607749.276399:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541073792:12345-0@lo:400:kworker.0 Request processed in 767us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607749.276409:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789607749.276526:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541073792:0@lo:400:kworker.0 00000100:00100000:0.0:1789607749.279714:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607749.279838:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541074432:0@lo:400:kworker.0 00000100:00100000:0.0:1789607749.279882:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607749.280048:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541074432 00000100:00100000:2.0:1789607749.280060:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541074432 00000100:00100000:2.0:1789607749.280150:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789607749.280161:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541074432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607749.280230:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541074432:12345-0@lo:400:kworker.0 Request processed in 70us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607749.280238:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789607749.280851:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789607749.280901:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffafea00 x1876539541074432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607749.280920:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541074432:0@lo:400:kworker.0 00000100:00100000:1.0:1789607749.281044:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541073920 00000100:00100000:1.0:1789607749.281052:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541073920 00000100:00100000:1.0:1789607749.281108:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789607749.281117:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541073920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607749.281178:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541073920:12345-0@lo:400:kworker.0 Request processed in 63us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607749.281206:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789607749.281322:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541073920:0@lo:400:kworker.0 00000100:00100000:2.0:1789607749.771770:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607749.771806:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541074560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607749.771906:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607749.772091:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541074560 00000100:00100000:1.0:1789607749.772103:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541074560 00000100:00100000:2.0:1789607749.781395:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789607749.781460:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541074560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607749.781528:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607749.781679:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541074560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 264us (9773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607749.781688:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789607749.781899:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffafca80 x1876539541074560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607749.781943:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541074560:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789607750.030277:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607751.051834:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607751.308404:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607751.308447:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541074688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607751.308545:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607751.308749:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541074688 00000100:00100000:2.0:1789607751.308758:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541074688 00000100:00100000:2.0:1789607751.308827:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789607751.308837:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541074688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607751.308884:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607751.308934:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541074688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607751.308941:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789607751.308981:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4ba300 x1876539541074688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607751.309000:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541074688:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607751.309130:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789607752.075884:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789607752.423600:0:10129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 21:15:51 (1789607751) === 00000100:00100000:3.0:1789607752.996185:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607752.996302:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520067072 00000100:00100000:0.0:1789607752.996312:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520067072 00000100:00100000:0.0:1789607752.996370:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 209 00000100:00100000:0.0:1789607752.996388:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:8159:x1876539520067072:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789607752.996406:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607752.996644:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103ba00/0x33f091d0013860cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b94d0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607752.996679:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103ba00/0x33f091d0013860cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94d0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607752.996692:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103ba00/0x33f091d0013860cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94d0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607752.996701:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103ba00, rc 0) 00000100:00100000:0.0:1789607752.996764:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:8159:x1876539520067072:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 385us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607752.996772:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 209 00000100:00100000:1.0:1789607753.002734:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607753.002836:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520067200 00000100:00100000:2.0:1789607753.002847:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520067200 00000100:00100000:2.0:1789607753.002908:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 210 00000100:00100000:2.0:1789607753.002918:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:8159:x1876539520067200:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789607753.003305:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:8159:x1876539520067200:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 387us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607753.003313:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 210 00000100:00100000:2.0:1789607753.015907:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607753.016009:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520067328 00000100:00100000:0.0:1789607753.016021:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520067328 00000100:00100000:0.0:1789607753.016116:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 211 00000100:00100000:0.0:1789607753.016158:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:8159:x1876539520067328:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789607753.016398:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:8159:x1876539520067328:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 257us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607753.016407:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 211 00000100:00100000:3.0:1789607753.021170:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607753.022870:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520067456 00000100:00100000:2.0:1789607753.022886:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520067456 00000100:00100000:2.0:1789607753.022939:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 212 00000100:00100000:2.0:1789607753.022949:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:8163:x1876539520067456:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607753.023308:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:8163:x1876539520067456:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 359us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607753.023327:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 212 00000100:00100000:1.0:1789607753.043497:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607753.043677:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520067584 00000100:00100000:2.0:1789607753.043692:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520067584 00000100:00100000:2.0:1789607753.043739:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 213 00000100:00100000:2.0:1789607753.043748:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:8163:x1876539520067584:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607753.044042:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:8163:x1876539520067584:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 294us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607753.044051:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 213 00000100:00100000:3.0:1789607753.063964:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607753.064256:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520067712 00000100:00100000:1.0:1789607753.064266:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520067712 00000100:00100000:1.0:1789607753.064331:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 214 00000100:00100000:1.0:1789607753.064342:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:8159:x1876539520067712:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789607753.064361:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607753.064382:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c167c400/0x33f091d0013860d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b94fa expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607753.064412:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c167c400/0x33f091d0013860d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94fa expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607753.064450:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c167c400/0x33f091d0013860d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94fa expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607753.064460:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c167c400, rc 0) 00000100:00100000:1.0:1789607753.064515:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:8159:x1876539520067712:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 176us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607753.064522:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 214 00000100:00100000:3.0:1789607753.070923:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607753.071237:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520067840 00000100:00100000:0.0:1789607753.071248:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520067840 00000100:00100000:0.0:1789607753.071305:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 215 00000100:00100000:0.0:1789607753.071315:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:8159:x1876539520067840:12345-192.168.202.3@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789607753.071342:0:5842:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789607753.071371:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789607753.071375:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789607753.071384:0:5842:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789607753.071386:0:5842:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789607753.077154:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:8159:x1876539520067840:12345-192.168.202.3@tcp:256:mount.lustre.0 Request processed in 5816us (6217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607753.077169:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 215 00000100:00100000:3.0:1789607753.083783:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607753.083893:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520067968 00000100:00100000:2.0:1789607753.083905:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520067968 00000100:00100000:2.0:1789607753.083966:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 216 00000100:00100000:2.0:1789607753.083976:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:8159:x1876539520067968:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789607753.083993:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607753.084011:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c1510800/0x33f091d0013860db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9501 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607753.084044:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c1510800/0x33f091d0013860db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9501 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607753.084055:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c1510800/0x33f091d0013860db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9501 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607753.084063:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1510800, rc 0) 00000100:00100000:2.0:1789607753.084232:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:8159:x1876539520067968:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 255us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607753.084239:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 216 00000100:00100000:3.0:1789607753.095383:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607753.098319:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520068096 00000100:00100000:1.0:1789607753.098340:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520068096 00000100:00100000:1.0:1789607753.098411:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 217 00000100:00100000:1.0:1789607753.098627:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:8159:x1876539520068096:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789607753.098949:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:8159:x1876539520068096:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 528us (3576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607753.098958:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 217 00000100:00100000:3.0:1789607753.102844:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607753.102926:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520068224 00000100:00100000:1.0:1789607753.102935:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520068224 00000100:00100000:1.0:1789607753.102988:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 218 00000100:00100000:1.0:1789607753.102999:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:8159:x1876539520068224:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789607753.108996:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:8159:x1876539520068224:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 5982us (6144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607753.109013:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 218 00010000:00010000:3.0:1789607753.112714:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607753.120555:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607753.120704:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520068352 00000100:00100000:3.0:1789607753.120714:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520068352 00000100:00100000:3.0:1789607753.120771:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 219 00000100:00100000:3.0:1789607753.120794:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:8167:x1876539520068352:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789607753.121049:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:8167:x1876539520068352:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 255us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607753.121057:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 219 00000100:00100000:2.0:1789607753.135130:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607753.144370:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520068480 00000100:00100000:1.0:1789607753.144388:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520068480 00000100:00100000:1.0:1789607753.144477:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 220 00000100:00100000:1.0:1789607753.144488:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:8167:x1876539520068480:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789607753.145103:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:8167:x1876539520068480:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 615us (9980us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607753.145112:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 220 00000100:00100000:0.0:1789607753.149113:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607753.149469:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520068736 00000100:00100000:3.0:1789607753.149479:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520068736 00000100:00100000:3.0:1789607753.149572:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:3.0:1789607753.149584:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520068736:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607753.149670:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520068736:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 88us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607753.149677:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00080000:0.0:1789607753.149742:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607753.171838:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607753.172361:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520068608 00000100:00100000:1.0:1789607753.172373:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520068608 00000100:00100000:1.0:1789607753.172441:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:1.0:1789607753.172449:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2372:x1876539520068608:12345-192.168.202.3@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789607753.172479:0:5849:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 1d227a0f-0368-435f-aa0d-1a7ac54e4639@192.168.202.3@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:1.0:1789607753.172549:0:5849:0:(genops.c:1384:class_connect()) connect: client 1d227a0f-0368-435f-aa0d-1a7ac54e4639, cookie 0x33f091d0013860e2 00000004:00100000:1.0:1789607753.172583:0:5849:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789607753.172878:0:5849:0:(import.c:65:import_set_state_nolock()) ffff99a1f500d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607753.172948:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:2372:x1876539520068608:12345-192.168.202.3@tcp:38:mount.lustre.0 Request processed in 497us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607753.172957:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1789607753.180481:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607753.180574:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520068864 00000100:00100000:3.0:1789607753.180585:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520068864 00000100:00100000:3.0:1789607753.180668:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:3.0:1789607753.180678:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:0:x1876539520068864:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789607753.180725:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607753.180815:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:0:x1876539520068864:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 138us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607753.180822:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00080000:0.0:1789607753.181372:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607753.185866:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607753.187417:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520068992 00000100:00100000:1.0:1789607753.187470:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520068992 00000100:00100000:1.0:1789607753.187552:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:1.0:1789607753.187563:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:8159:x1876539520068992:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789607753.187605:0:5849:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607753.187693:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:8159:x1876539520068992:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 131us (1836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607753.187701:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:2.0:1789607753.207297:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607753.207467:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520069120 00000100:00100000:3.0:1789607753.207477:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520069120 00000100:00100000:3.0:1789607753.207547:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:3.0:1789607753.207560:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:8159:x1876539520069120:12345-192.168.202.3@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789607753.207658:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:8159:x1876539520069120:12345-192.168.202.3@tcp:40:mount.lustre.0 Request processed in 99us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607753.207684:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:3.0:1789607753.212730:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607753.212892:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520069248 00000100:00100000:1.0:1789607753.212903:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520069248 00000100:00100000:1.0:1789607753.212952:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:1.0:1789607753.212961:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2372:x1876539520069248:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789607753.212997:0:6694:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 1d227a0f-0368-435f-aa0d-1a7ac54e4639@192.168.202.3@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:1.0:1789607753.213033:0:6694:0:(genops.c:1384:class_connect()) connect: client 1d227a0f-0368-435f-aa0d-1a7ac54e4639, cookie 0x33f091d0013860e9 00002000:00100000:1.0:1789607753.213045:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1d227a0f-0368-435f-aa0d-1a7ac54e4639/ffff99a1f500c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789607753.213067:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789607753.213316:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789607753.213346:0:6694:0:(import.c:65:import_set_state_nolock()) ffff99a1f5008000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607753.213415:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:2372:x1876539520069248:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 453us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607753.214045:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:0.0:1789607753.216326:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607753.216400:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607753.216495:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520069504 00000100:00100000:3.0:1789607753.216504:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520069504 00000100:00100000:3.0:1789607753.216554:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:3.0:1789607753.216561:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:8159:x1876539520069504:12345-192.168.202.3@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789607753.216645:0:5850:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789607753.216740:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520069376 00000100:00100000:2.0:1789607753.216745:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520069376 00000100:00100000:3.0:1789607753.216830:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:8159:x1876539520069504:12345-192.168.202.3@tcp:33:mount.lustre.0 Request processed in 268us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607753.216838:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:2.0:1789607753.216841:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:2.0:1789607753.216848:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2372:x1876539520069376:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789607753.216876:0:6692:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 1d227a0f-0368-435f-aa0d-1a7ac54e4639@192.168.202.3@tcp t0 exp 0000000000000000 cur 287 last 0 00000020:00000080:2.0:1789607753.216909:0:6692:0:(genops.c:1384:class_connect()) connect: client 1d227a0f-0368-435f-aa0d-1a7ac54e4639, cookie 0x33f091d0013860f0 00002000:00100000:2.0:1789607753.216921:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1d227a0f-0368-435f-aa0d-1a7ac54e4639/ffff99a0c1ce7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789607753.216944:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789607753.217585:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789607753.217629:0:6692:0:(import.c:65:import_set_state_nolock()) ffff99a0c1ce0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607753.217668:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:2372:x1876539520069376:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 818us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607753.217676:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000001:00100000:3.0:1789607753.948043:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1d227a0f-0368-435f-aa0d-1a7ac54e4639 00010000:00010000:0.0:1789607754.124441:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607754.382871:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541074816:0@lo:400:kworker.0 00000100:00100000:3.0:1789607754.382922:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541075200:0@lo:400:kworker.0 00000100:00100000:0.0:1789607754.382942:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607754.382987:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541075328:0@lo:400:kworker.0 00000100:00100000:0.0:1789607754.383013:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607754.383201:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607754.383244:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541074944:0@lo:400:kworker.0 00000100:00100000:3.0:1789607754.383270:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607754.383288:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541075456:0@lo:400:kworker.0 00000100:00100000:3.0:1789607754.383306:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607754.383322:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607754.383327:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541075072:0@lo:400:kworker.0 00000100:00100000:3.0:1789607754.383345:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607754.383376:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541075328 00000100:00100000:3.0:1789607754.383384:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541075328 00000100:00100000:3.0:1789607754.383457:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541074944 00000100:00100000:3.0:1789607754.383461:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541074944 00000100:00100000:3.0:1789607754.383474:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541075072 00000100:00100000:3.0:1789607754.383481:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541075072 00000100:00100000:3.0:1789607754.383502:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789607754.383510:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541075328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607754.383564:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541075328:12345-0@lo:400:kworker.0 Request processed in 54us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607754.383572:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789607754.383604:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789607754.383610:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541074944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607754.383641:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541074944:12345-0@lo:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607754.383646:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789607754.383658:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789607754.383663:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541075072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607754.383689:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541075072:12345-0@lo:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607754.383694:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789607754.383776:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541075200 00000100:00100000:3.0:1789607754.383781:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541075200 00000100:00100000:3.0:1789607754.383806:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541075456 00000100:00100000:3.0:1789607754.383810:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541075456 00000100:00100000:3.0:1789607754.383831:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607754.383837:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541075200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607754.383885:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541075200:12345-0@lo:400:kworker.0 Request processed in 48us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607754.383891:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607754.383905:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607754.383910:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541075456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607754.383946:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541075456:12345-0@lo:400:kworker.0 Request processed in 35us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607754.384398:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789607754.384442:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607754.384445:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607754.384448:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607754.384481:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541075328:0@lo:400:kworker.0 00010000:00080000:3.0:1789607754.384516:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c9d37b80 x1876539541075200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607754.384526:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541075200:0@lo:400:kworker.0 00000100:00100000:3.0:1789607754.384545:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541075072:0@lo:400:kworker.0 00000100:00100000:3.0:1789607754.384553:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541074944:0@lo:400:kworker.0 00010000:00080000:3.0:1789607754.384563:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c9d35500 x1876539541075456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607754.384572:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541075456:0@lo:400:kworker.0 00000100:00100000:1.0:1789607754.386876:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541074816 00000100:00100000:1.0:1789607754.386889:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541074816 00000100:00100000:1.0:1789607754.386945:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789607754.386970:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541074816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607754.387102:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541074816:0@lo:400:kworker.0 00000100:00100000:1.0:1789607754.387130:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541074816:12345-0@lo:400:kworker.0 Request processed in 113us (4124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607754.387138:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789607754.891833:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541075584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607754.891907:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607754.891979:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541075584 00000100:00100000:2.0:1789607754.891987:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541075584 00000100:00100000:2.0:1789607754.892035:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789607754.892042:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541075584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607754.892060:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607754.892105:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541075584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607754.892110:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789607754.892183:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffafd880 x1876539541075584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607754.892205:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541075584:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789607755.149801:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607756.172588:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607756.427725:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541075712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607756.427805:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607756.427920:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541075712 00000100:00100000:1.0:1789607756.427928:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541075712 00000100:00100000:1.0:1789607756.427983:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789607756.427993:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541075712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607756.428027:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607756.428086:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541075712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607756.428093:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789607756.428250:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4b9f80 x1876539541075712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607756.428270:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541075712:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789607756.428332:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789607757.017389:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1d227a0f-0368-435f-aa0d-1a7ac54e4639 00010000:00010000:0.0:1789607757.205743:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789607757.516350:0:5869:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1d227a0f-0368-435f-aa0d-1a7ac54e4639 00010000:00010000:0.0:1789607758.219834:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607758.648822:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607758.648881:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520069632 00000100:00100000:1.0:1789607758.648893:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520069632 00000100:00100000:1.0:1789607758.648951:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 222 00000100:00100000:1.0:1789607758.648961:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520069632:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607758.648974:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607758.649001:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520069760 00000100:00100000:2.0:1789607758.649004:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520069760 00000100:00100000:1.0:1789607758.649033:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520069632:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607758.649041:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 222 00000100:00100000:2.0:1789607758.649043:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00100000:2.0:1789607758.649050:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520069760:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607758.649081:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520069760:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607758.649087:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00080000:2.0:1789607758.649106:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607758.651782:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607758.651818:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607758.651851:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607758.651881:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520069888 00000100:00100000:1.0:1789607758.651889:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520069888 00000100:00100000:1.0:1789607758.651952:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:1.0:1789607758.651963:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520069888:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607758.652031:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520069888:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607758.652039:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:1.0:1789607758.652073:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520070016 00000100:00100000:1.0:1789607758.652077:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520070016 00000100:00100000:1.0:1789607758.652106:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520070144 00000100:00100000:1.0:1789607758.652110:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520070144 00000100:00100000:2.0:1789607758.652111:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:2.0:1789607758.652119:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520070016:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607758.652132:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:1.0:1789607758.652137:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520070144:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607758.652148:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520070016:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607758.652154:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:1.0:1789607758.652158:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520070144:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 22us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607758.652163:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00080000:2.0:1789607758.652171:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607758.652174:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607758.652177:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1789607758.719917:0:10325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1789607759.249264:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607759.501152:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541076224:0@lo:400:kworker.0 00000100:00100000:2.0:1789607759.501154:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541076096:0@lo:400:kworker.0 00000100:00100000:0.0:1789607759.501260:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541075840:0@lo:400:kworker.0 00000100:00100000:3.0:1789607759.501561:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607759.501666:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541076224 00000100:00100000:3.0:1789607759.501674:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541076224 00000100:00100000:3.0:1789607759.501742:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607759.501754:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a2016ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541076224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607759.501809:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a2016ce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541076224:12345-0@lo:400:kworker.0 Request processed in 57us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607759.501817:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607759.501823:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541075968:0@lo:400:kworker.0 00000100:00100000:1.0:1789607759.501865:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607759.501889:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541076480:0@lo:400:kworker.0 00000100:00100000:1.0:1789607759.501910:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607759.501942:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541076480 00000100:00100000:1.0:1789607759.501945:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541076480 00000100:00100000:1.0:1789607759.501970:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789607759.501975:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541076480:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789607759.502012:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4baa00 x1876539541076224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607759.502019:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541076480:12345-0@lo:400:kworker.0 Request processed in 44us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607759.502025:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607759.502028:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541076224:0@lo:400:kworker.0 00010000:00080000:1.0:1789607759.502051:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee290a80 x1876539541076480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789607759.502056:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607759.502060:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607759.502060:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541076480:0@lo:400:kworker.0 00000100:00100000:3.0:1789607759.502073:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541075968 00000100:00100000:3.0:1789607759.502076:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541075968 00000100:00100000:3.0:1789607759.502106:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789607759.502113:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541075968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607759.502210:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541075968:12345-0@lo:400:kworker.0 Request processed in 97us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607759.502216:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789607759.504273:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541075968:0@lo:400:kworker.0 00000100:00100000:2.0:1789607759.511093:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607759.511444:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541076096 00000100:00100000:1.0:1789607759.511454:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541076096 00000100:00100000:1.0:1789607759.511550:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789607759.511563:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541076096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607759.511649:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541076096:12345-0@lo:400:kworker.0 Request processed in 90us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607759.511656:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789607759.511867:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541076096:0@lo:400:kworker.0 00000100:00080000:3.0:1789607759.512078:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607759.513259:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607759.513317:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541076352:0@lo:400:kworker.0 00000100:00100000:0.0:1789607759.513351:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607759.513738:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541075840 00000100:00100000:2.0:1789607759.513748:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541075840 00000100:00100000:2.0:1789607759.513811:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789607759.513820:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541075840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607759.513896:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541075840:12345-0@lo:400:kworker.0 Request processed in 77us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607759.513904:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789607759.514045:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541075840:0@lo:400:kworker.0 00000100:00100000:3.0:1789607759.514622:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541076352 00000100:00100000:3.0:1789607759.514630:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541076352 00000100:00100000:3.0:1789607759.514697:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607759.514705:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541076352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607759.514781:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541076352:12345-0@lo:400:kworker.0 Request processed in 77us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607759.514800:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789607759.514993:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541076352:0@lo:400:kworker.0 00000100:00080000:2.0:1789607759.515321:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607760.011766:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541076608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607760.011844:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607760.012032:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541076608 00000100:00100000:1.0:1789607760.012042:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541076608 00000100:00100000:1.0:1789607760.012099:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607760.012109:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541076608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607760.012156:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607760.013384:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541076608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1272us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607760.013396:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1789607760.020548:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffafc380 x1876539541076608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607776 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607760.020579:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541076608:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789607760.268034:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607761.301722:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607761.548853:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607761.548879:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541076736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607761.548958:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607761.549159:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541076736 00000100:00100000:2.0:1789607761.549167:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541076736 00000100:00100000:2.0:1789607761.549228:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789607761.549237:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541076736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607761.549275:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607761.549320:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541076736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607761.549327:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1789607761.549681:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789607761.549714:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee293800 x1876539541076736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607761.549731:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541076736:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789607762.316627:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607763.346756:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607763.783699:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607763.783777:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607763.783809:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607763.783835:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607763.783879:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607763.783924:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520070400 00000100:00100000:2.0:1789607763.783938:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520070400 00000100:00100000:2.0:1789607763.784010:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520070528 00000100:00100000:2.0:1789607763.784014:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520070528 00000100:00100000:2.0:1789607763.784049:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:2.0:1789607763.784060:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520070400:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607763.784157:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520070400:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 99us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607763.784165:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:2.0:1789607763.784187:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:2.0:1789607763.784194:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520070528:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607763.784220:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520070528:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607763.784226:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:2.0:1789607763.784247:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520070656 00000100:00100000:2.0:1789607763.784250:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520070656 00000100:00100000:2.0:1789607763.784278:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520070784 00000100:00100000:2.0:1789607763.784281:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520070784 00000100:00100000:2.0:1789607763.784302:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:2.0:1789607763.784308:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520070656:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607763.784336:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520070656:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 28us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607763.784342:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:2.0:1789607763.784362:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:2.0:1789607763.784368:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520070784:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607763.784396:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520070784:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 28us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607763.784402:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00080000:2.0:1789607763.784780:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607763.784786:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607763.784789:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607763.800525:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520070272 00000100:00100000:3.0:1789607763.800548:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520070272 00000100:00100000:3.0:1789607763.800756:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 224 00000100:00100000:3.0:1789607763.800770:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2374:x1876539520070272:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607763.800876:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2374:x1876539520070272:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 108us (17193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607763.800885:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 224 00010000:00010000:1.0:1789607764.370104:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607764.621002:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541076864:0@lo:400:kworker.0 00000100:00100000:3.0:1789607764.621099:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607764.621164:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541077376:0@lo:400:kworker.0 00000100:00100000:3.0:1789607764.621197:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607764.622642:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541077120:0@lo:400:kworker.0 00000100:00100000:0.0:1789607764.626878:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541077248:0@lo:400:kworker.0 00000100:00100000:1.0:1789607764.627167:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541076992:0@lo:400:kworker.0 00000100:00100000:1.0:1789607764.627244:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541076864 00000100:00100000:1.0:1789607764.627255:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541076864 00000100:00100000:1.0:1789607764.627333:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789607764.627344:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541076864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607764.627523:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541076864:12345-0@lo:400:kworker.0 Request processed in 179us (6423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607764.627532:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789607764.627898:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607764.627951:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607764.628584:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541077248 00000100:00100000:2.0:1789607764.628592:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541077248 00000100:00100000:2.0:1789607764.628644:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789607764.628653:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541077248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607764.628712:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541077248:12345-0@lo:400:kworker.0 Request processed in 61us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607764.628720:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1789607764.628740:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607764.628805:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541076864:0@lo:400:kworker.0 00010000:00080000:0.0:1789607764.636128:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c9d35180 x1876539541077248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607764.636157:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541077248:0@lo:400:kworker.0 00000100:00100000:1.0:1789607764.637142:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541077376 00000100:00100000:1.0:1789607764.637157:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541077376 00000100:00100000:3.0:1789607764.637723:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541077504:0@lo:400:kworker.0 00000100:00100000:3.0:1789607764.637803:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607764.637845:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541076992 00000100:00100000:3.0:1789607764.637851:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541076992 00000100:00100000:1.0:1789607764.637906:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789607764.637919:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541077376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607764.638013:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541077376:12345-0@lo:400:kworker.0 Request processed in 98us (16815us total) trans 0 rc 0/0 00000100:00080000:2.0:1789607764.638182:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607764.638226:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541077376:0@lo:400:kworker.0 00000100:00100000:2.0:1789607764.638271:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607764.638310:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541077120 00000100:00100000:2.0:1789607764.638313:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541077120 00000100:00100000:3.0:1789607764.638655:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789607764.638666:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541076992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607764.638714:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541076992:12345-0@lo:400:kworker.0 Request processed in 51us (10818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607764.638722:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789607764.638751:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541077504 00000100:00100000:3.0:1789607764.638757:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541077504 00000100:00100000:3.0:1789607764.638789:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607764.638816:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541077504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607764.638853:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541077504:12345-0@lo:400:kworker.0 Request processed in 39us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607764.638859:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607764.638896:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541076992:0@lo:400:kworker.0 00010000:00080000:3.0:1789607764.638912:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c9d37800 x1876539541077504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607764.638924:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541077504:0@lo:400:kworker.0 00000100:00080000:3.0:1789607764.638954:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607764.638959:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607764.639373:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789607764.646708:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789607764.646745:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541077120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607764.646893:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541077120:12345-0@lo:400:kworker.0 Request processed in 170us (8619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607764.646921:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789607764.647040:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541077120:0@lo:400:kworker.0 00000100:00100000:0.0:1789607765.133970:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607765.134010:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541077632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607765.134123:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607765.134264:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541077632 00000100:00100000:1.0:1789607765.134275:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541077632 00000100:00100000:1.0:1789607765.134342:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607765.134353:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541077632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607765.134401:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607765.134502:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541077632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607765.134510:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789607765.134566:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffafc380 x1876539541077632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607781 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607765.134588:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541077632:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789607765.396495:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607766.413965:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607766.667697:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607766.667733:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff81b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541077760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607766.667839:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607766.668274:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541077760 00000100:00100000:1.0:1789607766.668293:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541077760 00000100:00100000:1.0:1789607766.668404:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789607766.668415:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541077760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607766.668482:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789607766.668608:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607766.668831:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541077760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 415us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607766.668842:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1789607766.668894:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff81b480 x1876539541077760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607766.668925:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff81b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541077760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789607767.435718:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607768.469701:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607768.882072:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607768.882103:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607768.882126:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607768.882151:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607768.882165:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520070912 00000100:00100000:3.0:1789607768.882176:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520070912 00000100:00100000:2.0:1789607768.882181:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607768.882208:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520071424 00000100:00100000:2.0:1789607768.882212:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520071424 00000100:00100000:3.0:1789607768.882235:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 226 00000100:00100000:3.0:1789607768.882248:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520070912:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607768.882258:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520071296 00000100:00100000:2.0:1789607768.882263:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520071296 00000100:00100000:2.0:1789607768.882289:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:2.0:1789607768.882298:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520071424:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607768.882335:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520071168 00000100:00100000:3.0:1789607768.882337:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520070912:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 91us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607768.882338:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520071424:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 40us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607768.882339:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520071168 00000100:00100000:3.0:1789607768.882354:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 226 00000100:00100000:2.0:1789607768.882355:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:0.0:1789607768.882373:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520071040 00000100:00100000:2.0:1789607768.882375:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:0.0:1789607768.882377:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520071040 00000100:00100000:2.0:1789607768.882383:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520071296:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607768.882404:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 83 00000100:00100000:3.0:1789607768.882412:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:0.0:1789607768.882414:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520071168:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607768.882457:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520071296:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607768.882460:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520071040:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607768.882472:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:0.0:1789607768.882480:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520071168:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 70us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607768.882486:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 83 00000100:00100000:3.0:1789607768.882502:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520071040:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 79us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607768.882510:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00080000:2.0:1789607768.883387:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607768.883394:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607768.883396:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789607769.483681:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607769.739797:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541078272:0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.739864:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.739931:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789607769.739938:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541077888:0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.739967:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.739991:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541078400:0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740015:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.740042:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541078016:0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740080:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.740097:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541078528:0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740116:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.740132:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607769.740138:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541078144:0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740154:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607769.740180:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541078272 00000100:00100000:3.0:1789607769.740186:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541078272 00000100:00100000:3.0:1789607769.740233:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541078528 00000100:00100000:3.0:1789607769.740236:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541078528 00000100:00100000:3.0:1789607769.740258:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789607769.740278:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541078272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740325:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541078272:12345-0@lo:400:kworker.0 Request processed in 60us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607769.740331:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789607769.740346:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789607769.740352:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541078528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740378:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541078528:12345-0@lo:400:kworker.0 Request processed in 27us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607769.740383:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789607769.740407:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541077888 00000100:00100000:3.0:1789607769.740410:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541077888 00000100:00100000:3.0:1789607769.740465:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789607769.740473:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541077888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740502:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541077888:12345-0@lo:400:kworker.0 Request processed in 31us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607769.740507:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789607769.740531:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541078400 00000100:00100000:3.0:1789607769.740535:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541078400 00000100:00100000:3.0:1789607769.740559:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541078016 00000100:00100000:3.0:1789607769.740561:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541078016 00000100:00100000:3.0:1789607769.740571:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541078144 00000100:00100000:3.0:1789607769.740573:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541078144 00000100:00100000:3.0:1789607769.740586:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789607769.740592:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541078400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740621:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541078400:12345-0@lo:400:kworker.0 Request processed in 30us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607769.740627:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789607769.740638:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789607769.740643:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541078016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740668:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541078016:12345-0@lo:400:kworker.0 Request processed in 25us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607769.740673:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789607769.740684:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789607769.740689:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541078144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740714:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541078144:12345-0@lo:400:kworker.0 Request processed in 25us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607769.740729:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1789607769.740752:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607769.740757:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607769.740759:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607769.740799:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541078144:0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740809:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541078016:0@lo:400:kworker.0 00010000:00080000:3.0:1789607769.740819:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c9d35f80 x1876539541078528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607769.740827:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541078528:0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740853:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541077888:0@lo:400:kworker.0 00000100:00100000:3.0:1789607769.740862:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541078400:0@lo:400:kworker.0 00010000:00080000:3.0:1789607769.740871:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c9d37480 x1876539541078272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607769.740878:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541078272:0@lo:400:kworker.0 00000100:00100000:2.0:1789607770.267252:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541078656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607770.267332:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607770.267500:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541078656 00000100:00100000:1.0:1789607770.267508:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541078656 00000100:00100000:1.0:1789607770.267562:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789607770.267573:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541078656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607770.267608:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607770.282725:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541078656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15143us (15383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607770.282742:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789607770.285697:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee18dc00 x1876539541078656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607770.285724:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541078656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789607770.508861:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607771.536786:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607771.789163:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607771.789185:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541078784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607771.789255:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607771.789312:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541078784 00000100:00100000:3.0:1789607771.789318:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541078784 00000100:00100000:3.0:1789607771.789371:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607771.789380:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541078784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607771.789415:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607771.789485:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541078784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607771.789500:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789607771.789522:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607771.789551:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ee18c700 x1876539541078784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607771.789569:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee18c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541078784:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789607772.555956:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607773.579729:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607774.009023:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607774.009097:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607774.009137:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607774.009184:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520071808 00000100:00100000:3.0:1789607774.009199:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520071808 00000100:00100000:3.0:1789607774.009284:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520071680 00000100:00100000:3.0:1789607774.009288:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520071680 00000100:00100000:3.0:1789607774.009334:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 88 00000100:00100000:3.0:1789607774.009358:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2376:x1876539520071808:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607774.009509:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2376:x1876539520071808:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 164us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607774.009518:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 88 00000100:00100000:3.0:1789607774.009542:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 89 00000100:00100000:3.0:1789607774.009549:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520071680:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607774.009574:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520071680:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607774.009581:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 89 00000100:00080000:3.0:1789607774.009600:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607774.009884:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520071552 00000100:00100000:1.0:1789607774.009891:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520071552 00000100:00100000:1.0:1789607774.009937:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 228 00000100:00100000:1.0:1789607774.009945:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2376:x1876539520071552:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607774.009996:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2376:x1876539520071552:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 53us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607774.010004:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 228 00000100:00100000:0.0:1789607774.022802:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607774.022848:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607774.023080:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520071936 00000100:00100000:3.0:1789607774.023090:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520071936 00000100:00100000:3.0:1789607774.023165:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520072064 00000100:00100000:3.0:1789607774.023170:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520072064 00000100:00100000:3.0:1789607774.023196:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1789607774.023207:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2372:x1876539520071936:12345-192.168.202.3@tcp:9:kworker.0 00000020:00000080:3.0:1789607774.023235:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d0013860e9 00000100:00080000:3.0:1789607774.023245:0:6695:0:(import.c:65:import_set_state_nolock()) ffff99a1f5008000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789607774.023283:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789607774.023692:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+2:2372:x1876539520071936:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 484us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607774.023702:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1789607774.023726:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:3.0:1789607774.023735:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2372:x1876539520072064:12345-192.168.202.3@tcp:9:kworker.0 00000020:00000080:3.0:1789607774.023751:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d0013860f0 00000100:00080000:3.0:1789607774.023763:0:6695:0:(import.c:65:import_set_state_nolock()) ffff99a0c1ce0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789607774.023790:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789607774.023986:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+2:2372:x1876539520072064:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 251us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607774.023994:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00010000:00010000:3.0:1789607774.024023:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607774.024030:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789607774.026091:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607774.026101:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789607774.392475:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1d227a0f-0368-435f-aa0d-1a7ac54e4639 00000020:00000080:1.0:1789607774.392483:0:6718:0:(genops.c:885:class_export_put()) final put ffff99a1f500c800/1d227a0f-0368-435f-aa0d-1a7ac54e4639 00000020:00000080:3.0:1789607774.392684:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1f500c800/1d227a0f-0368-435f-aa0d-1a7ac54e4639 for lustre-OST0000 00000020:00000080:3.0:1789607774.392737:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1f5008000 for lustre-OST0000 00010000:00010000:3.0:1789607774.603990:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607774.859858:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541079040:0@lo:400:kworker.0 00000100:00100000:3.0:1789607774.859944:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607774.859993:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541079552:0@lo:400:kworker.0 00000100:00100000:3.0:1789607774.860033:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607774.860068:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607774.860073:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541079168:0@lo:400:kworker.0 00000100:00100000:3.0:1789607774.860095:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607774.860129:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541079040 00000100:00100000:3.0:1789607774.860138:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541079040 00000100:00100000:3.0:1789607774.860192:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541079168 00000100:00100000:3.0:1789607774.860196:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541079168 00000100:00100000:3.0:1789607774.860230:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789607774.860239:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541079040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607774.860305:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541079040:12345-0@lo:400:kworker.0 Request processed in 67us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607774.860312:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789607774.860330:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789607774.860342:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541079168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607774.860369:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541079168:12345-0@lo:400:kworker.0 Request processed in 31us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607774.860375:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789607774.860408:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541079552 00000100:00100000:3.0:1789607774.860412:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541079552 00000100:00100000:3.0:1789607774.860466:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789607774.860474:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541079552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607774.860505:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541079552:12345-0@lo:400:kworker.0 Request processed in 33us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607774.860510:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789607774.860560:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541079168:0@lo:400:kworker.0 00000100:00100000:3.0:1789607774.860583:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541079040:0@lo:400:kworker.0 00010000:00080000:3.0:1789607774.860595:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c9d34000 x1876539541079552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607774.860605:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541079552:0@lo:400:kworker.0 00000100:00100000:2.0:1789607774.860685:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541078912:0@lo:400:kworker.0 00000100:00100000:2.0:1789607774.860719:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607774.860751:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541079424:0@lo:400:kworker.0 00000100:00100000:2.0:1789607774.860790:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607774.860813:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607774.860819:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541079296:0@lo:400:kworker.0 00000100:00100000:2.0:1789607774.860843:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607774.860875:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541079424 00000100:00100000:2.0:1789607774.860879:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541079424 00000100:00100000:2.0:1789607774.860906:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789607774.860912:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541079424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607774.860946:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541079424:12345-0@lo:400:kworker.0 Request processed in 35us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607774.860958:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789607774.860975:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541079296 00000100:00100000:2.0:1789607774.860979:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541079296 00000100:00100000:2.0:1789607774.861001:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789607774.861007:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541079296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607774.861037:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541079296:12345-0@lo:400:kworker.0 Request processed in 30us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607774.861043:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789607774.861070:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c9d35f80 x1876539541079296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607774.861080:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541079296:0@lo:400:kworker.0 00000100:00100000:2.0:1789607774.861090:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541079424:0@lo:400:kworker.0 00000100:00080000:0.0:1789607774.861172:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607774.861176:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607774.861178:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607774.861220:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541078912 00000100:00100000:3.0:1789607774.861225:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541078912 00000100:00100000:3.0:1789607774.861292:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789607774.861300:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541078912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607774.861343:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541078912:12345-0@lo:400:kworker.0 Request processed in 44us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607774.861349:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789607774.861414:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541078912:0@lo:400:kworker.0 00000100:00100000:0.0:1789607775.372187:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607775.372221:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541079680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607775.372291:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607775.372454:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541079680 00000100:00100000:3.0:1789607775.372464:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541079680 00000100:00100000:3.0:1789607775.372526:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607775.372535:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541079680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607775.372567:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607775.372613:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541079680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607775.372619:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789607775.372696:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61c8000 x1876539541079680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607775.372715:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541079680:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789607775.628234:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789607776.638776:0:11025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789607776.652212:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607776.910536:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607776.910561:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541079808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607776.910645:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607776.911207:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541079808 00000100:00100000:3.0:1789607776.911216:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541079808 00000100:00100000:3.0:1789607776.911285:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789607776.911296:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541079808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607776.911350:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607776.911413:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541079808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607776.911443:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789607776.912173:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1f61c8000 x1876539541079808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607776.912192:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541079808:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607776.912392:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789607777.513256:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1d227a0f-0368-435f-aa0d-1a7ac54e4639 00000020:00000080:0.0:1789607777.513266:0:7651:0:(genops.c:885:class_export_put()) final put ffff99a0c1ce7000/1d227a0f-0368-435f-aa0d-1a7ac54e4639 00000020:00000080:1.0:1789607777.515532:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a0c1ce7000/1d227a0f-0368-435f-aa0d-1a7ac54e4639 for lustre-OST0001 00000020:00000080:1.0:1789607777.515608:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a0c1ce0000 for lustre-OST0001 00010000:00010000:3.0:1789607777.678186:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607778.699835:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607779.124218:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607779.124260:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607779.124300:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607779.124332:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520072448 00000100:00100000:2.0:1789607779.124342:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520072448 00000100:00100000:2.0:1789607779.124413:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520072320 00000100:00100000:2.0:1789607779.124416:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520072320 00000100:00100000:2.0:1789607779.124467:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 93 00000100:00100000:2.0:1789607779.124478:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2375:x1876539520072448:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607779.124549:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2375:x1876539520072448:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 74us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607779.124571:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 93 00000100:00100000:2.0:1789607779.124590:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 94 00000100:00100000:2.0:1789607779.124596:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2375:x1876539520072320:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607779.124623:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2375:x1876539520072320:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607779.124629:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 94 00000100:00100000:3.0:1789607779.125813:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520072192 00000100:00100000:3.0:1789607779.125822:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520072192 00000100:00100000:3.0:1789607779.125872:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 230 00000100:00100000:3.0:1789607779.125882:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2375:x1876539520072192:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607779.125924:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2375:x1876539520072192:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 44us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607779.125931:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 230 00000100:00080000:0.0:1789607779.126855:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789607779.723694:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607779.992831:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff9e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541080064:0@lo:400:kworker.0 00000100:00100000:0.0:1789607779.992906:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607779.992962:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff9e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541080576:0@lo:400:kworker.0 00000100:00100000:0.0:1789607779.993002:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607779.993039:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607779.993045:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541080192:0@lo:400:kworker.0 00000100:00100000:0.0:1789607779.993070:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607779.993106:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541080064 00000100:00100000:0.0:1789607779.993114:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541080064 00000100:00100000:0.0:1789607779.993163:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541080192 00000100:00100000:0.0:1789607779.993166:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541080192 00000100:00100000:0.0:1789607779.993198:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789607779.993208:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541080064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607779.993256:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541080064:12345-0@lo:400:kworker.0 Request processed in 50us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607779.993264:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789607779.993443:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541080320:0@lo:400:kworker.0 00000100:00100000:3.0:1789607779.993473:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607779.993493:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789607779.993498:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff9e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541079936:0@lo:400:kworker.0 00000100:00100000:3.0:1789607779.993520:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607779.993540:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff9e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541080448:0@lo:400:kworker.0 00000100:00100000:3.0:1789607779.993560:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607779.993590:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541080576 00000100:00100000:3.0:1789607779.993594:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541080576 00000100:00100000:3.0:1789607779.993624:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541080320 00000100:00100000:3.0:1789607779.993626:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541080320 00000100:00100000:3.0:1789607779.993644:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789607779.993650:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541080576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607779.993690:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541080576:12345-0@lo:400:kworker.0 Request processed in 40us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607779.993697:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789607779.993713:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607779.993718:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541080320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607779.993745:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541080320:12345-0@lo:400:kworker.0 Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607779.993751:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607779.993768:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541079936 00000100:00100000:3.0:1789607779.993771:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541079936 00000100:00100000:3.0:1789607779.993791:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789607779.993797:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541079936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607779.993823:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541079936:12345-0@lo:400:kworker.0 Request processed in 26us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607779.993829:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789607779.993869:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff9e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541079936:0@lo:400:kworker.0 00010000:00080000:3.0:1789607779.993883:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff9e6300 x1876539541080320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607779.993894:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff9e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541080320:0@lo:400:kworker.0 00000100:00080000:3.0:1789607779.993942:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607779.993946:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607779.993948:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607779.993956:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541080448 00000100:00100000:3.0:1789607779.993960:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541080448 00000100:00100000:3.0:1789607779.993984:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789607779.993990:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541080192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607779.994028:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541080192:12345-0@lo:400:kworker.0 Request processed in 38us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607779.994033:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789607779.994045:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789607779.994051:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541080448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607779.994080:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541080448:12345-0@lo:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607779.994085:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1789607779.994103:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607779.994117:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff9e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541080448:0@lo:400:kworker.0 00000100:00100000:3.0:1789607779.994146:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff9e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541080192:0@lo:400:kworker.0 00000100:00100000:3.0:1789607779.994155:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff9e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541080064:0@lo:400:kworker.0 00010000:00080000:3.0:1789607779.994164:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff9e4e00 x1876539541080576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607779.994173:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff9e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541080576:0@lo:400:kworker.0 00000100:00100000:1.0:1789607780.495670:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607780.495695:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffaff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541080704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607780.495760:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607780.495826:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541080704 00000100:00100000:1.0:1789607780.495834:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541080704 00000100:00100000:1.0:1789607780.495879:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789607780.495887:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541080704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607780.495920:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607780.495962:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541080704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607780.495969:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789607780.496012:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffaff100 x1876539541080704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607780.496054:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffaff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541080704:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1789607780.541000:0:11175:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf270b1d0 20000000:00000080:1.0:1789607780.541542:0:11175:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a1e4d47000 uarg=0000000000000000 20000000:01000000:1.0:1789607780.541587:0:11175:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789607780.541593:0:11175:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789607780.541598:0:11175:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789607780.549015:0:11176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789607780.549850:0:11175:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789607780.556737:0:11175:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789607780.556884:0:11175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607780.556904:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d103b800/0x33f091d0013860a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138609c expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607780.556913:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1c167d800/0x33f091d0013860b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013860aa expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607780.556921:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1c1510e00/0x33f091d0013860bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013860b8 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607780.556946:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1c167c800/0x33f091d0013860c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94c9 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607780.556954:0:11175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1c1510800/0x33f091d0013860db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9501 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607780.556960:0:11175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607780.557006:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1c1510800/0x33f091d0013860db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9501 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607780.557103:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1c1510800/0x33f091d0013860db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9501 expref: 12 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607780.557121:0:11175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1876539541080832:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607780.557371:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1c167c800/0x33f091d0013860c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94c9 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607780.557381:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1c167c800/0x33f091d0013860c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94c9 expref: 12 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607780.557391:0:11175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1876539541080960:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607780.557457:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1c1510e00/0x33f091d0013860bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d0013860b8 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607780.557466:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1c1510e00/0x33f091d0013860bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d0013860b8 expref: 18 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607780.557487:0:11175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1876539541081088:0@lo:104: 00000100:00100000:0.0:1789607780.557533:0:11175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607780.557574:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1c167d800/0x33f091d0013860b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d0013860aa expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607780.557583:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1c167d800/0x33f091d0013860b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d0013860aa expref: 18 pid: 5839 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607780.557591:0:11175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1876539541081216:0@lo:104: 00000100:00100000:0.0:1789607780.557612:0:11175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607780.557636:0:11175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d103b800/0x33f091d0013860a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d00138609c expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607780.557644:0:11175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d103b800/0x33f091d0013860a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d00138609c expref: 18 pid: 5842 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607780.557653:0:11175:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1876539541081344:0@lo:104: 00000100:00100000:0.0:1789607780.557673:0:11175:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607780.557684:0:11175:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e89d8240 going to sleep for 11 seconds 00000100:00100000:1.0:1789607780.558013:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541081088 00000100:00100000:1.0:1789607780.558031:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541081088 00000100:00100000:1.0:1789607780.558074:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541081216 00000100:00100000:1.0:1789607780.558077:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541081216 00000100:00100000:1.0:1789607780.558087:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541081344 00000100:00100000:1.0:1789607780.558089:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541081344 00000100:00100000:1.0:1789607780.558100:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607780.558109:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:11175:x1876539541081088:12345-0@lo:104: 00010000:00010000:1.0:1789607780.558122:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013860bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558171:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789607780.558176:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:11175:x1876539541081088:12345-0@lo:104: Request processed in 69us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607780.558183:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789607780.558199:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607780.558205:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:11175:x1876539541081216:12345-0@lo:104: 00010000:00010000:1.0:1789607780.558224:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013860b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558266:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789607780.558270:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:11175:x1876539541081216:12345-0@lo:104: Request processed in 66us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607780.558288:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789607780.558300:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607780.558305:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:11175:x1876539541081344:12345-0@lo:104: 00010000:00010000:1.0:1789607780.558312:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013860a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558352:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789607780.558357:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:11175:x1876539541081344:12345-0@lo:104: Request processed in 52us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607780.558362:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1789607780.558530:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789607780.558536:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013860bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558543:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c167de00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:1.0:1789607780.558547:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d0013860bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558555:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d0013860bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607780.558562:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d0013860bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607780.558568:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789607780.558602:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013860bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558608:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607780.558626:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013860bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558632:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c167de00/0x33f091d0013860b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013860bf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558645:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607780.558647:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013860b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558653:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c167dc00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:1.0:1789607780.558655:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d0013860b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558662:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d0013860b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607780.558667:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d0013860b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607780.558672:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789607780.558684:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013860b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558689:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607780.558694:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013860b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558710:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c167dc00/0x33f091d0013860aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013860b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558719:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607780.558722:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013860a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558728:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c167d200 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:1.0:1789607780.558731:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d0013860a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558737:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d0013860a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607780.558743:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d0013860a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607780.558748:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789607780.558761:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013860a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558767:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607780.558782:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013860a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558789:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c167d200/0x33f091d00138609c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013860a3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.558801:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607780.558808:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607780.558810:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607780.558830:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541081728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607780.558865:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607780.559200:0:11175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1876539541081088:0@lo:104: 00000100:00100000:2.0:1789607780.559316:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541081600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607780.559355:0:11175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1876539541081216:0@lo:104: 00000100:00100000:2.0:1789607780.560771:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607780.560828:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607780.560837:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffaff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541081472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607780.560864:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607780.560893:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541081728 00000100:00100000:2.0:1789607780.560900:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541081728 00010000:00010000:2.0:1789607780.560933:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d103b800/0x33f091d0013860a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d00138609c expref: 19 pid: 5842 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607780.560957:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541081600 00000100:00100000:2.0:1789607780.560960:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541081600 00010000:00010000:2.0:1789607780.560971:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1c167d800/0x33f091d0013860b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d0013860aa expref: 20 pid: 5839 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607780.560981:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541081472 00000100:00100000:2.0:1789607780.560983:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541081472 00010000:00010000:2.0:1789607780.560991:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1c1510e00/0x33f091d0013860bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d0013860b8 expref: 21 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607780.561002:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789607780.561009:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+21:3311:x1876539541081728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607780.561040:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607780.561045:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d103b800/0x33f091d0013860a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d00138609c expref: 21 pid: 5842 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607780.561056:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d103b800/0x33f091d0013860a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d00138609c expref: 21 pid: 5842 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607780.561076:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607780.561113:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c73850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+21:3311:x1876539541081728:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607780.561119:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789607780.561164:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789607780.561170:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+20:3310:x1876539541081600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607780.561177:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607780.561182:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1c167d800/0x33f091d0013860b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d0013860aa expref: 20 pid: 5839 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607780.561190:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1c167d800/0x33f091d0013860b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d0013860aa expref: 20 pid: 5839 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607780.561200:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167d800/0x33f091d0013860b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d0013860aa expref: 20 pid: 5839 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607780.561223:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607780.561250:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541081600:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607780.561257:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789607780.561269:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607780.561473:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:3310:x1876539541081472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607780.561489:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607780.561494:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1c1510e00/0x33f091d0013860bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d0013860b8 expref: 18 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607780.561502:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1c1510e00/0x33f091d0013860bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d0013860b8 expref: 18 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607780.561512:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c1510e00/0x33f091d0013860bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d0013860b8 expref: 18 pid: 5841 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607780.561522:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607780.561545:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:3310:x1876539541081472:12345-0@lo:103:ldlm_bl.0 Request processed in 270us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607780.561551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607780.561592:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541081728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607780.561618:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffaff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541081472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607780.561625:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541081600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607780.561816:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103b800/0x33f091d0013860a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d00138609c expref: 16 pid: 5842 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607780.561828:0:11175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1876539541081344:0@lo:104: 00010000:00010000:0.0:1789607780.561874:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607780.566177:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607780.566392:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520072704 00000100:00100000:1.0:1789607780.566402:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520072704 00010000:00010000:1.0:1789607780.566470:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1c1510800/0x33f091d0013860db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9501 expref: 13 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607780.566509:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:1.0:1789607780.566520:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520072704:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607780.566535:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607780.566541:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1c1510800/0x33f091d0013860db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9501 expref: 13 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.566553:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1c1510800/0x33f091d0013860db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9501 expref: 13 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.566573:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607780.566898:0:11175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1876539541080960:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607780.566927:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c1510800/0x33f091d0013860db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9501 expref: 13 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607780.566943:0:11175:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11175:1876539541080832:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607780.566976:0:11175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607780.567188:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:2373:x1876539520072704:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 668us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607780.567196:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:3.0:1789607780.568780:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607780.568867:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520072576 00000100:00100000:1.0:1789607780.568877:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520072576 00010000:00010000:1.0:1789607780.568912:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1c167c800/0x33f091d0013860c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94c9 expref: 12 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607780.568951:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:1.0:1789607780.568961:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:2374:x1876539520072576:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607780.568987:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607780.568993:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1c167c800/0x33f091d0013860c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94c9 expref: 12 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.569005:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1c167c800/0x33f091d0013860c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94c9 expref: 12 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.569112:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167c800/0x33f091d0013860c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94c9 expref: 12 pid: 5839 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.569130:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.569138:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.569154:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.569160:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.569166:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.569173:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.569178:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607780.569182:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.569198:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.569362:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.569375:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607780.569453:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:2374:x1876539520072576:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 462us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607780.569461:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 29 00010000:00010000:2.0:1789607780.569590:0:11175:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607780.569600:0:11175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607780.569606:0:11175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103a200/0x33f091d0013860f7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607780.750981:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607781.771700:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607781.877998:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607781.878161:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520072832 00000100:00100000:0.0:1789607781.878173:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520072832 00000100:00100000:0.0:1789607781.878253:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 232 00000100:00100000:0.0:1789607781.878266:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:5616:x1876539520072832:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607781.878288:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607781.878314:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103b800/0x33f091d0013860fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b952b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607781.878355:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103b800/0x33f091d0013860fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b952b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607781.878367:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103b800/0x33f091d0013860fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b952b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607781.878376:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b800, rc 0) 00000100:00100000:0.0:1789607781.878448:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:5616:x1876539520072832:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 187us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607781.878455:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 232 00000100:00100000:2.0:1789607781.885621:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607781.885735:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520072960 00000100:00100000:0.0:1789607781.885747:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520072960 00000100:00100000:0.0:1789607781.885815:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 233 00000100:00100000:0.0:1789607781.885826:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:5616:x1876539520072960:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607781.886139:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:5616:x1876539520072960:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 313us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607781.886147:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 233 00000100:00100000:2.0:1789607781.889364:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607781.889556:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520073088 00000100:00100000:1.0:1789607781.889566:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520073088 00000100:00100000:1.0:1789607781.889655:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 234 00000100:00100000:1.0:1789607781.889666:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:5616:x1876539520073088:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607781.889894:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:5616:x1876539520073088:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 229us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607781.889903:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 234 00000100:00100000:0.0:1789607781.901835:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607781.902857:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520073216 00000100:00100000:1.0:1789607781.902882:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520073216 00000100:00100000:1.0:1789607781.903028:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 235 00000100:00100000:1.0:1789607781.903041:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:5616:x1876539520073216:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607781.903060:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607781.903078:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ff4ef800/0x33f091d001386105 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9532 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607781.903107:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff4ef800/0x33f091d001386105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9532 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607781.903129:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ff4ef800/0x33f091d001386105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9532 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607781.903147:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef800, rc 0) 00000100:00100000:1.0:1789607781.903212:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:5616:x1876539520073216:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 173us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607781.903219:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 235 00000100:00100000:2.0:1789607781.905776:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607781.907666:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520073344 00000100:00100000:1.0:1789607781.907682:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520073344 00000100:00100000:1.0:1789607781.907756:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 236 00000100:00100000:1.0:1789607781.907767:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:5616:x1876539520073344:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607781.908257:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:5616:x1876539520073344:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 490us (2489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607781.908266:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 236 00000100:00100000:2.0:1789607781.919611:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607781.927615:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520073472 00000100:00100000:0.0:1789607781.927631:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520073472 00000100:00100000:0.0:1789607781.928404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 237 00000100:00100000:0.0:1789607781.928420:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:5616:x1876539520073472:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607781.928780:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:5616:x1876539520073472:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 364us (9181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607781.928790:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 237 00000100:00100000:0.0:1789607782.027804:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541081856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607782.027887:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607782.027992:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541081856 00000100:00100000:1.0:1789607782.028003:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541081856 00000100:00100000:1.0:1789607782.028075:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789607782.028086:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541081856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607782.028122:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789607782.028187:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607782.040641:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541081856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12547us (12743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607782.040656:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789607782.042630:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c9d34000 x1876539541081856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607782.042656:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541081856:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1789607782.347488:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789607782.347496:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1e8ccd800 from 7 10000000:01000000:1.0:1789607782.347501:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789607782.347546:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607782.347565:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607782.347577:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607782.347603:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffaff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541081984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607782.347671:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607782.348471:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1eeb6acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607782.348551:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541081984 00000100:00100000:3.0:1789607782.348563:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541081984 00000100:00100000:3.0:1789607782.348624:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789607782.348634:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541081984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607782.348648:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607782.348672:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558f200/0x33f091d001386113 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d00138610c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607782.348698:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558f200/0x33f091d001386113 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d00138610c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607782.348709:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558f200/0x33f091d001386113 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138610c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607782.348718:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f200, rc 0) 00000100:00100000:3.0:1789607782.348767:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541081984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607782.348774:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1789607782.349094:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffaff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541081984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607782.349111:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386113 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607782.349121:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386113 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607782.349194:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607782.349227:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.349307:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e89d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607782.352911:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541082112 00000100:00100000:3.0:1789607782.352927:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541082112 00000100:00100000:3.0:1789607782.352990:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789607782.353000:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541082112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607782.353560:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607782.353614:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607782.353662:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607782.353695:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607782.353753:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541082240 00000100:00100000:1.0:1789607782.353759:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541082240 00000100:00100000:1.0:1789607782.353795:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789607782.353802:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541082240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607782.353941:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541082240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607782.353949:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789607782.354025:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541082112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1026us (4796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607782.354032:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789607782.355922:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789607782.368373:0:11207:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789607782.369575:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789607782.369602:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607782.369613:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386113 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607782.369626:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386113 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607782.369637:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607782.369640:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1c8d84800 from 7 10000000:01000000:2.0:1789607782.369643:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607782.369681:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607782.369690:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607782.369703:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607782.369732:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607782.369810:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607782.369854:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607782.373607:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541082368 00000100:00100000:0.0:1789607782.373628:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541082368 00000100:00100000:0.0:1789607782.373707:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789607782.373717:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541082368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607782.373733:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607782.373753:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103a200/0x33f091d001386121 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d00138611a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607782.373780:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103a200/0x33f091d001386121 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d00138611a expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607782.373790:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103a200/0x33f091d001386121 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138611a expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607782.373798:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a200, rc 0) 00000100:00100000:0.0:1789607782.373879:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541082368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (4068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607782.373885:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789607782.374026:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607782.374052:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607782.374061:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607782.374131:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607782.374164:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607782.374204:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607782.374232:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541082496 00000100:00100000:2.0:1789607782.374236:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541082496 00000100:00100000:2.0:1789607782.374262:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789607782.374269:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541082496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607782.374566:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541082496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607782.374572:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789607782.374601:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607782.374627:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607782.374665:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607782.374677:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607782.374685:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541082624 00000100:00100000:2.0:1789607782.374687:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541082624 00000100:00100000:2.0:1789607782.374701:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789607782.374710:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541082624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607782.374807:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541082624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607782.374812:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789607782.374839:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789607782.380919:0:11209:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789607782.381104:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789607782.381129:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607782.381141:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607782.381153:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607782.381164:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789607782.381182:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1c98a7800 from 7 10000000:01000000:3.0:1789607782.381185:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607782.381223:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607782.381232:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607782.381244:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607782.381271:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607782.381353:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607782.381397:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607782.381637:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541082752 00000100:00100000:3.0:1789607782.381646:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541082752 00000100:00100000:3.0:1789607782.381690:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789607782.381700:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541082752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607782.381713:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607782.381725:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558e000/0x33f091d00138612f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001386128 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607782.381749:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558e000/0x33f091d00138612f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001386128 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607782.381759:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558e000/0x33f091d00138612f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001386128 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607782.381767:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e000, rc 0) 00000100:00100000:3.0:1789607782.381805:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541082752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607782.381818:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789607782.381866:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607782.381880:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138612f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607782.381888:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138612f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607782.381934:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607782.381960:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607782.381973:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15480 going to sleep for 11 seconds 00000100:00100000:0.0:1789607782.382097:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541082880 00000100:00100000:0.0:1789607782.382102:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541082880 00000100:00100000:0.0:1789607782.382136:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789607782.382144:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541082880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607782.382392:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541082880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607782.382406:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789607782.382462:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541082880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607782.382493:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541083008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607782.382533:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607782.382554:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff9a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789607782.382564:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541083008 00000100:00100000:0.0:1789607782.382568:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541083008 00000100:00100000:0.0:1789607782.382585:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789607782.382590:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541083008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789607782.382729:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541083008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607782.382735:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789607782.382771:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541083008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789607782.383814:0:11210:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789607782.384147:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789607782.384166:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607782.384176:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138612f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607782.384187:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138612f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607782.798579:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607783.819742:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607784.252555:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607784.252594:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520073728 00000100:00100000:3.0:1789607784.252604:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607784.252606:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520073728 00000100:00100000:3.0:1789607784.252636:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607784.252663:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520073600 00000100:00100000:3.0:1789607784.252668:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520073600 00000100:00100000:2.0:1789607784.252678:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520073856 00000100:00100000:2.0:1789607784.252684:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520073856 00000100:00100000:3.0:1789607784.252706:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 247 00000100:00100000:2.0:1789607784.252716:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:3.0:1789607784.252720:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520073600:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607784.252729:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520073728:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607784.252800:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520073728:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607784.252807:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:2.0:1789607784.252825:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00100000:2.0:1789607784.252831:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520073856:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607784.254910:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520073600:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 2048us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607784.254924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 247 00000100:00100000:2.0:1789607784.255076:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520073856:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 2242us (2436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607784.255095:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00080000:2.0:1789607784.255125:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789607784.846599:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607785.100916:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541083264:0@lo:400:kworker.0 00000100:00100000:0.0:1789607785.100988:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607785.101057:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541083776:0@lo:400:kworker.0 00000100:00100000:0.0:1789607785.101080:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607785.101108:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789607785.101113:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541083136:0@lo:400:kworker.0 00000100:00100000:0.0:1789607785.101137:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607785.101158:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541083648:0@lo:400:kworker.0 00000100:00100000:0.0:1789607785.101177:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607785.101201:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541083520:0@lo:400:kworker.0 00000100:00100000:0.0:1789607785.101230:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607785.101262:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607785.101267:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541083392:0@lo:400:kworker.0 00000100:00100000:0.0:1789607785.101286:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607785.101328:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541083264 00000100:00100000:0.0:1789607785.101336:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541083264 00000100:00100000:3.0:1789607785.101681:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541083776 00000100:00100000:3.0:1789607785.101687:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541083776 00000100:00100000:3.0:1789607785.101731:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541083520 00000100:00100000:3.0:1789607785.101734:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541083520 00000100:00100000:3.0:1789607785.101770:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789607785.101779:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541083776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607785.101841:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541083776:12345-0@lo:400:kworker.0 Request processed in 63us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607785.101848:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789607785.101865:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789607785.101871:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541083520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607785.101904:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541083520:12345-0@lo:400:kworker.0 Request processed in 33us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607785.101910:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1789607785.101929:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607785.101933:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789607785.101976:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c8dc2300 x1876539541083520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607785.101991:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541083520:0@lo:400:kworker.0 00000100:00100000:0.0:1789607785.102019:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541083648 00010000:00080000:3.0:1789607785.102021:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c8dc0e00 x1876539541083776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607785.102023:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541083648 00000100:00100000:3.0:1789607785.102030:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541083776:0@lo:400:kworker.0 00000100:00080000:3.0:1789607785.102042:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789607785.108828:0:11373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789607785.109015:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541083392 00000100:00100000:2.0:1789607785.109030:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541083392 00000100:00100000:2.0:1789607785.109103:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789607785.109115:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541083264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607785.109243:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541083264:12345-0@lo:400:kworker.0 Request processed in 118us (8243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607785.109252:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789607785.109270:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789607785.109277:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541083648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607785.109319:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541083648:12345-0@lo:400:kworker.0 Request processed in 43us (8140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607785.109325:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789607785.109338:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789607785.109344:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541083392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607785.109392:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541083392:12345-0@lo:400:kworker.0 Request processed in 49us (8104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607785.109398:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1789607785.109450:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607785.109491:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541083648:0@lo:400:kworker.0 00000100:00100000:2.0:1789607785.109505:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541083264:0@lo:400:kworker.0 00000100:00100000:2.0:1789607785.109539:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541083392:0@lo:400:kworker.0 00000100:00100000:1.0:1789607785.113585:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541083136 00000100:00100000:1.0:1789607785.113606:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541083136 00000100:00100000:1.0:1789607785.114385:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789607785.114398:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541083136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607785.114540:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541083136:12345-0@lo:400:kworker.0 Request processed in 146us (13401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607785.114548:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1789607785.114608:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541083136:0@lo:400:kworker.0 00000100:00100000:0.0:1789607785.611798:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607785.611824:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541083904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607785.611892:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607785.612012:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541083904 00000100:00100000:1.0:1789607785.612020:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541083904 00000100:00100000:1.0:1789607785.612071:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789607785.612080:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541083904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607785.612124:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607785.612172:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541083904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607785.612179:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789607785.612218:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ffafd880 x1876539541083904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607785.612249:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541083904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789607785.867884:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607786.893558:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607787.147907:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541084032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607787.148011:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607787.148250:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541084032 00000100:00100000:3.0:1789607787.148261:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541084032 00000100:00100000:3.0:1789607787.148346:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789607787.148356:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541084032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607787.148403:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607787.148494:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541084032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607787.148502:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789607787.148702:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607787.148780:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1c9d34000 x1876539541084032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607787.148816:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541084032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789607787.917712:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607788.948474:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789607789.040722:0:11474:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 21:16:27 (1789607787) === 00000100:00100000:2.0:1789607789.368689:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607789.368736:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607789.368760:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607789.368970:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520074240 00000100:00100000:1.0:1789607789.368981:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520074240 00000100:00100000:1.0:1789607789.369050:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520074112 00000100:00100000:1.0:1789607789.369054:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520074112 00000100:00100000:1.0:1789607789.369080:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 103 00000100:00100000:1.0:1789607789.369091:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2376:x1876539520074240:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607789.369167:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2376:x1876539520074240:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 77us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607789.369175:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 103 00000100:00100000:1.0:1789607789.369192:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 104 00000100:00100000:1.0:1789607789.369198:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520074112:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607789.369241:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520074112:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 43us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607789.369249:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 104 00000100:00100000:3.0:1789607789.369451:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520073984 00000100:00100000:3.0:1789607789.369457:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520073984 00000100:00100000:3.0:1789607789.369618:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 249 00000100:00100000:3.0:1789607789.369626:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2376:x1876539520073984:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607789.369656:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2376:x1876539520073984:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 33us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607789.369662:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 249 00000100:00080000:2.0:1789607789.370596:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607789.456384:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607789.456789:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520074368 00000100:00100000:1.0:1789607789.456800:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520074368 00000100:00100000:1.0:1789607789.457060:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:1.0:1789607789.457072:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2375:x1876539520074368:12345-192.168.202.3@tcp:41:mkdir.0 00000004:00000024:1.0:1789607789.457115:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607789.457200:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2375:x1876539520074368:12345-192.168.202.3@tcp:41:mkdir.0 Request processed in 131us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607789.457207:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1789607789.458657:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607789.465515:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520074496 00000100:00100000:2.0:1789607789.465532:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520074496 00000100:00100000:2.0:1789607789.465606:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:2.0:1789607789.465618:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:9713:x1876539520074496:12345-192.168.202.3@tcp:700:mkdir.0 00000100:00100000:2.0:1789607789.465721:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:9713:x1876539520074496:12345-192.168.202.3@tcp:700:mkdir.0 Request processed in 106us (7071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607789.465729:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:1.0:1789607789.470638:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607789.474260:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520074752 00000100:00100000:0.0:1789607789.474278:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520074752 00000100:00100000:0.0:1789607789.474369:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:0.0:1789607789.474379:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:9713:x1876539520074752:12345-192.168.202.3@tcp:36:mkdir.0 00010000:00010000:0.0:1789607789.474458:0:6790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607789.474683:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c167da00/0x33f091d001386017 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94b4 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.474703:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7db00) 00010000:00010000:0.0:1789607789.474713:0:6790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607789.475176:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386136 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.475196:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386136 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.475205:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386136 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.475236:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138613d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.475243:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138613d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.475260:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138613d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607789.479657:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789607789.479676:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386136 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.479687:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386136 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.479694:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386136 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.479700:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607789.479706:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386136 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.479713:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386136 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.479741:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1f911d500) 00010000:00010000:0.0:1789607789.479744:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607789.479749:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386136 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.479755:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386136 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607789.479775:0:6790:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c77292af reply state 000000004a7c381c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138613d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607789.479784:0:6790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789607789.479901:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:9713:x1876539520074752:12345-192.168.202.3@tcp:36:mkdir.0 Request processed in 5519us (9269us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789607789.479909:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00010000:00010000:2.0:1789607789.484150:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138613d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.484169:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138613d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.484176:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138613d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.484183:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607789.484187:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138613d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.484194:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138613d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.484230:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99a1f911d100) 00010000:00010000:2.0:1789607789.484233:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607789.484238:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138613d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.484245:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138613d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607789.504638:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607789.504884:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520074880 00000100:00100000:0.0:1789607789.504895:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520074880 00000100:00100000:0.0:1789607789.504962:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:0.0:1789607789.504972:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:9714:x1876539520074880:12345-192.168.202.3@tcp:101:chmod.0 00010000:00010000:0.0:1789607789.504993:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607789.505016:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9539 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.505080:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138614b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.505095:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138614b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.505124:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138614b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607789.505164:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607789.505168:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607789.505204:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138614b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.505230:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9539 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.505260:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138614b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9539 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.505270:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1f911d500) 00010000:00010000:0.0:1789607789.505273:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607789.505277:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b000, rc 0) 00000100:00100000:0.0:1789607789.505341:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:9714:x1876539520074880:12345-192.168.202.3@tcp:101:chmod.0 Request processed in 370us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607789.505349:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:0.0:1789607789.510279:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607789.510980:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520075136 00000100:00100000:3.0:1789607789.510991:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520075136 00000100:00100000:3.0:1789607789.511052:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:3.0:1789607789.511062:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:9714:x1876539520075136:12345-192.168.202.3@tcp:36:chmod.0 00010000:00010000:3.0:1789607789.511114:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607789.511142:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138614b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9539 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.511164:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1f911d500) 00010000:00010000:3.0:1789607789.511176:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607789.511202:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386152 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.511215:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386152 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.511226:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386152 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607789.512063:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d6f5c48 reply state 0000000046cd46d1 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386152 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607789.512076:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789607789.512086:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789607789.512172:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:9714:x1876539520075136:12345-192.168.202.3@tcp:36:chmod.0 Request processed in 1109us (1905us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789607789.512181:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00010000:00010000:2.0:1789607789.516224:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386152 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.516240:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386152 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.516246:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386152 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.516260:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fe00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607789.516265:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386152 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.516274:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386152 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.518059:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c3982000) 00010000:00010000:2.0:1789607789.518070:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789607789.518081:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386152 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.518090:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386152 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607789.563137:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607789.563357:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520075264 00000100:00100000:1.0:1789607789.563480:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520075264 00000100:00100000:1.0:1789607789.563681:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:1.0:1789607789.563694:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:9715:x1876539520075264:12345-192.168.202.3@tcp:101:chown.0 00010000:00010000:1.0:1789607789.563728:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607789.563758:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386159 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9540 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.563851:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386160 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.563867:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386160 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.563904:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386160 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607789.563956:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789607789.563960:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607789.564006:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386160 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.564036:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386159 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9540 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.564060:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386160 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9540 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.564069:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7d100) 00010000:00010000:1.0:1789607789.564072:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607789.564076:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4efe00, rc 0) 00000100:00100000:1.0:1789607789.564159:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:9715:x1876539520075264:12345-192.168.202.3@tcp:101:chown.0 Request processed in 469us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607789.564166:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:0.0:1789607789.568436:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607789.571330:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520075392 00000100:00100000:2.0:1789607789.571352:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520075392 00000100:00100000:2.0:1789607789.571655:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:2.0:1789607789.571669:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:9715:x1876539520075392:12345-192.168.202.3@tcp:101:chown.0 00010000:00010000:2.0:1789607789.571696:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607789.571724:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d001386167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9547 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.571952:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138616e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.571972:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138616e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.571985:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138616e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572002:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386175 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572008:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572015:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572132:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d00138617c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572141:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d00138617c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572166:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d00138617c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607789.572338:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607789.572342:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607789.572574:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d00138617c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572590:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138616e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572598:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138616e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572604:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138616e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572610:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607789.572615:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138616e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572623:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138616e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572637:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7d100) 00010000:00010000:2.0:1789607789.572640:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607789.572647:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138616e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572654:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138616e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572683:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572689:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386175 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572694:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386175 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572699:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3e00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607789.572703:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386175 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572710:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386175 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572719:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99a1db790800) 00010000:00010000:2.0:1789607789.572721:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607789.572725:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386175 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572730:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386175 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572774:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d001386167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9547 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.572790:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d00138617c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9547 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.574068:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a1db790000) 00010000:00010000:2.0:1789607789.574076:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607789.574080:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3400, rc 0) 00000100:00100000:2.0:1789607789.575518:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:9715:x1876539520075392:12345-192.168.202.3@tcp:101:chown.0 Request processed in 2519us (5778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607789.575541:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:3.0:1789607789.583030:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607789.583467:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520075648 00000100:00100000:0.0:1789607789.583481:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520075648 00000100:00100000:0.0:1789607789.583561:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:0.0:1789607789.583572:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:9715:x1876539520075648:12345-192.168.202.3@tcp:36:chown.0 00010000:00010000:0.0:1789607789.583672:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607789.583710:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d00138617c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9547 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.583736:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a1db790000) 00010000:00010000:0.0:1789607789.583751:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607789.583791:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386183 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.583819:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.583834:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607789.628896:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789607789.628900:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ebe6dcc reply state 00000000a2dd0e6f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607789.628916:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789607789.628996:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789607789.629163:0:5848:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789607789.629193:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:9715:x1876539520075648:12345-192.168.202.3@tcp:36:chown.0 Request processed in 45615us (46174us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789607789.629204:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00010000:00010000:2.0:1789607789.629414:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386183 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.629449:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386183 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.629458:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386183 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.629465:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607789.629471:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386183 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.629481:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386183 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.629661:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:2.0:1789607789.629664:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789607789.629671:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386183 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.629678:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386183 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607789.649041:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607789.649302:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520075776 00000100:00100000:0.0:1789607789.649318:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520075776 00000100:00100000:0.0:1789607789.649602:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:0.0:1789607789.649615:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:9716:x1876539520075776:12345-192.168.202.3@tcp:101:touch.500 00010000:00010000:1.0:1789607789.649699:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607789.649730:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138618a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b954e expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789607789.652976:0:6790:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3167us 00010000:00010000:3.0:1789607789.674274:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e200/0x33f091d001386191 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674305:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e200/0x33f091d001386191 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674319:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e200/0x33f091d001386191 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674339:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ea00/0x33f091d001386198 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674346:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ea00/0x33f091d001386198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674352:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ea00/0x33f091d001386198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674808:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138619f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674824:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138619f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674832:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138619f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607789.674862:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789607789.674867:0:6790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607789.674940:0:6790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138619f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674956:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e200/0x33f091d001386191 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674963:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e200/0x33f091d001386191 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674971:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e200/0x33f091d001386191 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674978:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558e200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607789.674983:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e200/0x33f091d001386191 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.674992:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e200/0x33f091d001386191 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.675008:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7d100) 00010000:00010000:3.0:1789607789.675012:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607789.675019:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e200/0x33f091d001386191 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.675035:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e200/0x33f091d001386191 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.675049:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ea00/0x33f091d001386198 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.675055:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ea00/0x33f091d001386198 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.675060:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ea00/0x33f091d001386198 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.675064:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558ea00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607789.675068:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ea00/0x33f091d001386198 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.675073:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ea00/0x33f091d001386198 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.675081:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99a1c3982700) 00010000:00010000:3.0:1789607789.675084:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607789.675086:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ea00/0x33f091d001386198 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.675092:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ea00/0x33f091d001386198 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.675140:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138618a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b954e expref: 8 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.675159:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138619f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b954e expref: 7 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607789.675173:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a1c3982500) 00010000:00010000:3.0:1789607789.675176:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789607789.675179:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f000, rc 0) 00000100:00100000:3.0:1789607789.675292:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:9716:x1876539520075776:12345-192.168.202.3@tcp:101:touch.500 Request processed in 25679us (26333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607789.675303:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:3.0:1789607789.684389:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607789.684679:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520076032 00000100:00100000:1.0:1789607789.684692:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520076032 00000100:00100000:1.0:1789607789.684771:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:1.0:1789607789.684780:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:9716:x1876539520076032:12345-192.168.202.3@tcp:101:touch.500 00010000:00010000:1.0:1789607789.684824:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607789.684858:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d0013861a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9555 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.685190:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.685215:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.685231:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.685487:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d0013861b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.685510:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d0013861b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.685524:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d0013861b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789607789.690981:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789607789.694717:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013861bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.694746:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013861bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.694763:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013861bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.694844:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.694961:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.694967:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.694975:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607789.694979:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.694987:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.694999:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a1c3982500) 00010000:00010000:1.0:1789607789.695001:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607789.695006:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.695012:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607789.695028:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048c654c7 reply state 000000002863cdb0 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d0013861b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607789.695037:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789607789.695157:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d0013861a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9555 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.695186:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013861bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9555 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.695194:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a1dab7d000) 00010000:00010000:1.0:1789607789.695197:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607789.695199:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee800, rc 0) 00000100:00100000:1.0:1789607789.695289:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:9716:x1876539520076032:12345-192.168.202.3@tcp:101:touch.500 Request processed in 10509us (10920us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789607789.695298:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:3.0:1789607789.699107:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1789607789.699415:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d0013861b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.699466:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d0013861b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.699475:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d0013861b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.699482:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607789.699488:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d0013861b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.699496:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d0013861b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.699513:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf39068c8 (ffff99a1dab7dc00) 00010000:00010000:0.0:1789607789.699516:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607789.699529:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d0013861b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.699535:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d0013861b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607789.699854:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520076288 00000100:00100000:2.0:1789607789.699868:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520076288 00000100:00100000:2.0:1789607789.699953:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:2.0:1789607789.699966:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:9716:x1876539520076288:12345-192.168.202.3@tcp:36:touch.500 00010000:00010000:2.0:1789607789.700054:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607789.700084:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013861bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9555 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.700104:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a1dab7d000) 00010000:00010000:2.0:1789607789.700114:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607789.700171:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d0013861c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.700187:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d0013861c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.700199:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d0013861c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607789.700385:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e5fd0079 reply state 00000000671d40d5 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d0013861c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607789.700397:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607789.700552:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:9716:x1876539520076288:12345-192.168.202.3@tcp:36:touch.500 Request processed in 589us (1460us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789607789.700561:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00010000:00010000:2.0:1789607789.702511:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d0013861c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.702554:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d0013861c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.702563:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d0013861c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.702571:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607789.702578:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d0013861c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.702587:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d0013861c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.702605:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a1db790800) 00010000:00010000:2.0:1789607789.702609:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607789.702615:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d0013861c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.702622:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2000/0x33f091d0013861c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607789.703702:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607789.704020:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520076416 00000100:00100000:0.0:1789607789.704033:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520076416 00000100:00100000:0.0:1789607789.704106:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:0.0:1789607789.704116:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:9716:x1876539520076416:12345-192.168.202.3@tcp:101:touch.500 00010000:00010000:0.0:1789607789.704145:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607789.704184:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013861d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b955c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.704299:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013861d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b955c expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.704315:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013861d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b955c expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.704339:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a1f911d600) 00010000:00010000:0.0:1789607789.704343:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607789.704346:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103bc00, rc 0) 00000100:00100000:0.0:1789607789.704741:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:9716:x1876539520076416:12345-192.168.202.3@tcp:101:touch.500 Request processed in 624us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607789.704750:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:1.0:1789607789.716974:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607789.717062:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520076544 00000100:00100000:3.0:1789607789.717077:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520076544 00000100:00100000:3.0:1789607789.717176:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:3.0:1789607789.717188:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2372:x1876539520076544:12345-192.168.202.3@tcp:8:touch.500 00010000:00080000:3.0:1789607789.717233:0:6695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:3.0:1789607789.717292:0:6695:0:(genops.c:1384:class_connect()) connect: client d0d9aceb-01dc-4deb-add2-cd492a0443a6, cookie 0x33f091d0013861d7 00002000:00100000:3.0:1789607789.717307:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d0d9aceb-01dc-4deb-add2-cd492a0443a6/ffff99a1ffa5e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789607789.720061:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789607789.720403:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789607789.722010:0:6695:0:(import.c:65:import_set_state_nolock()) ffff99a1e4ce5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607789.722149:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2372:x1876539520076544:12345-192.168.202.3@tcp:8:touch.500 Request processed in 4955us (5185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607789.722173:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:2.0:1789607789.730673:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607789.730801:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520076672 00000100:00100000:3.0:1789607789.730825:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520076672 00000100:00100000:2.0:1789607789.731110:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:2.0:1789607789.731125:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:0:x1876539520076672:12345-192.168.202.3@tcp:2:touch.500 00000100:00080000:1.0:1789607789.731368:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789607789.787539:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1789607789.787567:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000100:00100000:3.0:1789607789.787788:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:0:x1876539520076672:12345-192.168.202.3@tcp:2:touch.500 Request processed in 56657us (57121us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789607789.787802:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:0.0:1789607789.792041:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607789.792144:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520076928 00000100:00100000:3.0:1789607789.792159:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520076928 00000100:00100000:3.0:1789607789.792336:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:3.0:1789607789.792351:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:9716:x1876539520076928:12345-192.168.202.3@tcp:35:touch.500 00000100:00100000:3.0:1789607789.792899:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:9716:x1876539520076928:12345-192.168.202.3@tcp:35:touch.500 Request processed in 549us (870us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789607789.792908:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:1.0:1789607789.807640:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607789.808906:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520077056 00000100:00100000:2.0:1789607789.808925:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520077056 00000100:00100000:0.0:1789607789.809233:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:0.0:1789607789.809259:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:9717:x1876539520077056:12345-192.168.202.3@tcp:101:rm.0 00010000:00010000:0.0:1789607789.809297:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607789.809325:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013861de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9563 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.809418:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013861e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.809457:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013861e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.809473:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013861e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607789.809540:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607789.809544:0:6790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607789.809592:0:6790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013861e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.809625:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013861de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9563 expref: 13 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.809646:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013861e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9563 expref: 12 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.809654:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a1c3982500) 00010000:00010000:0.0:1789607789.809658:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607789.809662:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a000, rc 0) 00000100:00100000:0.0:1789607789.809752:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+12:9717:x1876539520077056:12345-192.168.202.3@tcp:101:rm.0 Request processed in 508us (2127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607789.809760:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:2.0:1789607789.818789:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607789.822630:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520077312 00000100:00100000:1.0:1789607789.822650:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520077312 00000100:00100000:1.0:1789607789.822788:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:1.0:1789607789.822803:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+12:9717:x1876539520077312:12345-192.168.202.3@tcp:101:rm.0 00010000:00010000:1.0:1789607789.822833:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607789.822861:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b956a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607789.822997:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789607789.823238:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b956a expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.823276:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7d100) 00010000:00010000:1.0:1789607789.823280:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607789.823286:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d0013861ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b956a expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.823304:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef400, rc 0) 00000100:00100000:1.0:1789607789.823405:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:9717:x1876539520077312:12345-192.168.202.3@tcp:101:rm.0 Request processed in 605us (4631us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1789607789.823414:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:3.0:1789607789.827476:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607789.827642:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520077440 00000100:00100000:0.0:1789607789.827656:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520077440 00000100:00100000:0.0:1789607789.827728:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:0.0:1789607789.827740:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:9717:x1876539520077440:12345-192.168.202.3@tcp:37:rm.0 00000100:00100000:0.0:1789607789.836203:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:9717:x1876539520077440:12345-192.168.202.3@tcp:37:rm.0 Request processed in 8438us (8758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607789.836222:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:2.0:1789607789.842597:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607789.842805:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520077696 00000100:00100000:3.0:1789607789.842819:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520077696 00000100:00100000:3.0:1789607789.842957:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1789607789.842971:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1db76ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:9717:x1876539520077696:12345-192.168.202.3@tcp:35:rm.0 00000100:00100000:3.0:1789607789.843334:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1db76ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:9717:x1876539520077696:12345-192.168.202.3@tcp:35:rm.0 Request processed in 365us (751us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789607789.843344:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:2.0:1789607789.848846:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607789.849060:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520077952 00000100:00100000:0.0:1789607789.849073:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520077952 00000100:00100000:0.0:1789607789.849544:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:0.0:1789607789.849558:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:9717:x1876539520077952:12345-192.168.202.3@tcp:101:rm.0 00010000:00010000:0.0:1789607789.849593:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607789.849622:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013861fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9571 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.849757:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001386201 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.849776:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001386201 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.849789:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001386201 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607789.849802:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789607789.850055:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013861fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9571 expref: 17 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.850079:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001386201 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9571 expref: 16 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.850089:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a1c3982500) 00010000:00010000:0.0:1789607789.850093:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789607789.850098:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103ae00, rc 0) 00000100:00100000:0.0:1789607789.850515:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:9717:x1876539520077952:12345-192.168.202.3@tcp:101:rm.0 Request processed in 959us (1682us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789607789.850525:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:2.0:1789607789.854569:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607789.854744:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520078080 00000100:00100000:0.0:1789607789.854777:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520078080 00000100:00100000:0.0:1789607789.854900:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:0.0:1789607789.854916:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:9717:x1876539520078080:12345-192.168.202.3@tcp:41:rm.0 00000004:00000024:0.0:1789607789.855011:0:5848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789607789.855105:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:9717:x1876539520078080:12345-192.168.202.3@tcp:41:rm.0 Request processed in 193us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607789.855114:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:2.0:1789607789.857700:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607789.858023:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520078208 00000100:00100000:1.0:1789607789.858036:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520078208 00000100:00100000:1.0:1789607789.858115:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:1.0:1789607789.858127:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:9717:x1876539520078208:12345-192.168.202.3@tcp:101:rm.0 00010000:00010000:1.0:1789607789.858315:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607789.858345:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d00138620f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9578 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858476:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386216 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858497:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858511:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858531:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138621d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858559:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138621d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858568:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138621d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858833:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386224 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858843:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858851:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607789.858890:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789607789.858895:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607789.858919:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858934:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386224 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858943:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858950:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386216 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858957:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858975:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eec00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607789.858980:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.858989:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386216 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.859004:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a1c3982500) 00010000:00010000:1.0:1789607789.859007:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607789.859014:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386216 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.859021:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386216 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.859039:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138621d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.859045:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138621d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.859051:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138621d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.859057:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607789.859060:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138621d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.859066:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138621d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.859085:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf39068c8 (ffff99a1dab7dd00) 00010000:00010000:1.0:1789607789.859088:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607789.859091:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138621d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.859098:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138621d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.859140:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d00138620f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9578 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.859155:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386224 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9578 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.859163:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a1f911d600) 00010000:00010000:1.0:1789607789.859165:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607789.859168:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4eee00, rc 0) 00000100:00100000:1.0:1789607789.859338:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+17:9717:x1876539520078208:12345-192.168.202.3@tcp:101:rm.0 Request processed in 1212us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607789.859347:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:2.0:1789607789.864818:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607789.864911:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520078464 00000100:00100000:1.0:1789607789.864925:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520078464 00000100:00100000:1.0:1789607789.865018:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:1.0:1789607789.865033:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+17:9717:x1876539520078464:12345-192.168.202.3@tcp:36:rm.0 00010000:00010000:1.0:1789607789.865116:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789607789.865151:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386224 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9578 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.865218:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013861d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b955c expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.865231:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a1f911d600) 00010000:00010000:1.0:1789607789.865262:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013861e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9563 expref: 15 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.865270:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a1c3982500) 00010000:00010000:1.0:1789607789.865274:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607789.865302:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d00138622b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.865319:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d00138622b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.865331:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d00138622b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.865352:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386232 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.865359:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386232 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.865372:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386232 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.865555:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386239 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.865573:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386239 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.865580:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386239 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789607789.866522:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789607789.866537:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323711113880ns, next at 324711110714ns, rc = 0 00010000:00010000:1.0:1789607789.866616:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386240 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866631:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866640:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386240 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866648:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386240 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866655:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386240 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866661:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386240 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866687:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607789.866710:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386239 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866716:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386239 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866731:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386239 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866737:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607789.866742:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386239 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866751:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386239 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866764:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a1dab7d900) 00010000:00010000:1.0:1789607789.866767:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789607789.866772:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386239 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866778:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386239 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866798:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d00138622b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866804:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d00138622b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866809:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d00138622b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866814:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607789.866817:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d00138622b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866833:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d00138622b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866841:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a1c3982500) 00010000:00010000:1.0:1789607789.866843:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607789.866846:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d00138622b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.866851:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d00138622b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607789.866861:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b28722b7 reply state 00000000fd3f733e transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386232 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607789.866870:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607789.866977:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:9717:x1876539520078464:12345-192.168.202.3@tcp:36:rm.0 Request processed in 1944us (2171us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789607789.866986:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 30 00010000:00010000:2.0:1789607789.867865:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607789.867878:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386240 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.867887:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607789.867891:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386240 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.867899:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386240 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.867915:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a1dab7d900) 00010000:00010000:2.0:1789607789.867918:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789607789.867922:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386240 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.867927:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386240 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607789.867949:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607789.867951:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607789.867953:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607789.870211:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386232 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.870233:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386232 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.870242:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386232 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.870259:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607789.870265:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386232 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.870273:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386232 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.870291:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xf39068c8 (ffff99a1dab7d800) 00010000:00010000:0.0:1789607789.870295:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607789.870301:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386232 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607789.870308:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386232 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xf39068c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607789.874362:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607789.874518:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520078720 00000100:00100000:0.0:1789607789.874532:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520078720 00000100:00100000:0.0:1789607789.874600:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:0.0:1789607789.874613:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:9717:x1876539520078720:12345-192.168.202.3@tcp:35:rm.0 00000100:00100000:0.0:1789607789.874932:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:9717:x1876539520078720:12345-192.168.202.3@tcp:35:rm.0 Request processed in 320us (584us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789607789.874942:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:2.0:1789607789.878043:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607789.878151:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520078976 00000100:00100000:1.0:1789607789.878163:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520078976 00000100:00100000:1.0:1789607789.878349:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:1.0:1789607789.878361:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:9717:x1876539520078976:12345-192.168.202.3@tcp:36:rm.0 00010000:00010000:1.0:1789607789.878462:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789607789.878496:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001386201 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9571 expref: 16 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.878522:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138619f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b954e expref: 15 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.878556:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a1c3982500) 00010000:00010000:1.0:1789607789.878574:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386160 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9540 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.878584:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7d100) 00010000:00010000:1.0:1789607789.878591:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607789.878621:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386247 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.878635:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386247 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.878646:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386247 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.878658:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d00138624e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.878665:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d00138624e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.878671:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d00138624e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.879022:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386255 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.879031:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386255 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.879049:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386255 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607789.880392:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789607789.880418:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386255 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880503:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386255 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880512:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386255 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880518:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eee00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607789.880523:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386255 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880531:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386255 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880546:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a1dab7d900) 00010000:00010000:1.0:1789607789.880549:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789607789.880555:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386255 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880562:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386255 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880592:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386247 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880598:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386247 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880615:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386247 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880621:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607789.880624:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386247 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880630:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386247 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880638:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7dd00) 00010000:00010000:1.0:1789607789.880641:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607789.880644:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386247 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.880650:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386247 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607789.880662:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b1cef23 reply state 00000000d3a5561f transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d00138624e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607789.880673:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607789.880839:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:9717:x1876539520078976:12345-192.168.202.3@tcp:36:rm.0 Request processed in 2476us (2907us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789607789.880849:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 31 00010000:00010000:1.0:1789607789.884397:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d00138624e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.884448:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d00138624e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.884483:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d00138624e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.884490:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607789.884496:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d00138624e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.884505:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d00138624e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.884525:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99a1dab7d800) 00010000:00010000:1.0:1789607789.884528:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607789.884535:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d00138624e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.884541:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d00138624e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607789.964099:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607790.221645:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541084544:0@lo:400:kworker.0 00000100:00100000:3.0:1789607790.221737:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607790.221826:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607790.221832:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541084416:0@lo:400:kworker.0 00000100:00100000:3.0:1789607790.221857:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607790.222102:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff9e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541084288:0@lo:400:kworker.0 00000100:00100000:1.0:1789607790.222133:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607790.222172:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541084800:0@lo:400:kworker.0 00000100:00100000:1.0:1789607790.222218:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607790.222263:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789607790.222268:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff9e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541084160:0@lo:400:kworker.0 00000100:00100000:1.0:1789607790.222299:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607790.222319:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541084672:0@lo:400:kworker.0 00000100:00100000:1.0:1789607790.222340:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607790.222387:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541084544 00000100:00100000:1.0:1789607790.222396:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541084544 00000100:00100000:1.0:1789607790.222479:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541084800 00000100:00100000:1.0:1789607790.222482:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541084800 00000100:00100000:1.0:1789607790.222505:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789607790.222515:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541084544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607790.222576:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541084544:12345-0@lo:400:kworker.0 Request processed in 61us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607790.222583:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789607790.222602:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789607790.222609:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541084800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607790.222641:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541084800:12345-0@lo:400:kworker.0 Request processed in 33us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607790.222647:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789607790.222667:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541084160 00000100:00100000:1.0:1789607790.222671:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541084160 00000100:00100000:1.0:1789607790.222691:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789607790.222697:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541084160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607790.222725:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541084160:12345-0@lo:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607790.222731:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:1.0:1789607790.222754:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789607790.222758:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607790.222781:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff9e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541084160:0@lo:400:kworker.0 00010000:00080000:1.0:1789607790.222794:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4ace00 x1876539541084800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607790.222807:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541084800:0@lo:400:kworker.0 00000100:00100000:1.0:1789607790.222844:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541084416 00000100:00100000:1.0:1789607790.222847:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541084416 00000100:00100000:1.0:1789607790.222877:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541084288 00000100:00100000:1.0:1789607790.222880:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541084288 00000100:00100000:1.0:1789607790.222889:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541084672 00000100:00100000:1.0:1789607790.222891:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541084672 00000100:00100000:1.0:1789607790.222903:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789607790.222908:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541084416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607790.223097:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789607790.223107:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541084288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607790.223201:0:5849:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789607790.223212:0:5849:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789607790.223339:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789607790.223346:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541084672:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789607790.223446:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4ac380 x1876539541084544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607790.223456:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541084544:0@lo:400:kworker.0 00000100:00080000:3.0:1789607790.223630:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607790.224998:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541084288:12345-0@lo:400:kworker.0 Request processed in 1883us (2853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607790.225014:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789607790.225192:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff9e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541084288:0@lo:400:kworker.0 00000100:00100000:2.0:1789607790.226416:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541084672:12345-0@lo:400:kworker.0 Request processed in 3062us (4066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607790.226444:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789607790.226582:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541084672:0@lo:400:kworker.0 00000100:00100000:1.0:1789607790.226729:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541084416:12345-0@lo:400:kworker.0 Request processed in 3817us (4867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607790.226738:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789607790.228702:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541084416:0@lo:400:kworker.0 00000100:00100000:3.0:1789607790.736775:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607790.736810:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541084928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607790.736907:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607790.736994:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541084928 00000100:00100000:3.0:1789607790.737004:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541084928 00000100:00100000:3.0:1789607790.737070:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789607790.737081:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541084928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607790.737110:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607790.737159:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541084928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607790.737165:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789607790.737333:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4ae300 x1876539541084928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607790.737359:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541084928:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789607790.987733:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607792.016476:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607792.268365:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541085056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607792.268623:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607792.268846:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541085056 00000100:00100000:2.0:1789607792.268859:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541085056 00000100:00100000:2.0:1789607792.268939:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789607792.268952:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541085056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607792.269007:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607792.269069:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541085056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607792.269077:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1789607792.269151:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1e4d69f80 x1876539541085056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607792.269173:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541085056:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607792.269264:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789607793.037962:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607794.063768:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607794.481160:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607794.481224:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607794.481265:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607794.481294:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607794.481335:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520079360 00000100:00100000:2.0:1789607794.481348:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520079360 00000100:00100000:3.0:1789607794.481696:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520079104 00000100:00100000:3.0:1789607794.481702:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520079104 00000100:00100000:3.0:1789607794.481747:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 251 00000100:00100000:3.0:1789607794.481760:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2375:x1876539520079104:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607794.481872:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2375:x1876539520079104:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 113us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607794.481879:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 251 00000100:00100000:3.0:1789607794.481923:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520079232 00000100:00100000:3.0:1789607794.481928:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520079232 00000100:00100000:3.0:1789607794.481960:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520079488 00000100:00100000:3.0:1789607794.481963:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520079488 00000100:00100000:3.0:1789607794.481990:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 108 00000100:00100000:3.0:1789607794.482007:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:2375:x1876539520079232:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607794.482050:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:2375:x1876539520079232:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 44us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607794.482057:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 108 00000100:00100000:3.0:1789607794.482070:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 109 00000100:00100000:3.0:1789607794.482077:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2375:x1876539520079488:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607794.482102:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2375:x1876539520079488:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 25us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607794.482108:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 109 00000100:00080000:3.0:1789607794.482753:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607794.482760:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607794.482899:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:2.0:1789607794.482910:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520079360:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607794.482962:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520079360:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 56us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607794.482968:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 60 00000001:02000400:0.0:1789607794.743336:0:11625:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1789607794.958921:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:2.0:1789607794.958947:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1789607794.958956:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789607794.959381:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789607794.959404:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541085184:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789607794.959505:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607794.959580:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541085184 00000100:00100000:3.0:1789607794.959588:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541085184 00000100:00100000:3.0:1789607794.959667:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789607794.959677:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541085184:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789607794.959706:0:8471:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1789607794.959747:0:8471:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aab3f6d, atime: 0x6aab3f6d, ctime: 0x6aab3f6d, blocks: 0x1 00010000:00010000:3.0:1789607794.959755:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000056e4a07/0x33f091d00138625c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607794.959771:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1789607794.959776:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607794.959783:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000056e4a07/0x33f091d00138625c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607794.959815:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000056e4a07/0x33f091d00138625c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607794.959827:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000056e4a07/0x33f091d00138625c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607794.959835:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000056e4a07/0x33f091d00138625c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607794.960003:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789607794.960568:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1876539541085184:12345-0@lo:6:osp-syn-1-0.0 Request processed in 890us (1061us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789607794.960576:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789607794.960610:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789607794.960627:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607794.960634:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000056e4a07/0x33f091d00138625c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607794.960771:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558e200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:3.0:1789607794.960776:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000056e4a07/0x33f091d00138625c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607794.960787:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000056e4a07/0x33f091d00138625c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607794.960818:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000056e4a07/0x33f091d00138625c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607794.960826:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000056e4a07/0x33f091d00138625c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607794.960948:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607794.960951:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607794.960953:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789607794.960990:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a1ff4ae300/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789607794.960996:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541085184:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789607795.086481:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607795.343702:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541085440:0@lo:400:kworker.0 00000100:00100000:1.0:1789607795.343809:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607795.343908:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541085952:0@lo:400:kworker.0 00000100:00100000:1.0:1789607795.343937:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607795.343975:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607795.343981:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541085568:0@lo:400:kworker.0 00000100:00100000:1.0:1789607795.344007:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607795.344056:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541085440 00000100:00100000:1.0:1789607795.344067:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541085440 00000100:00100000:1.0:1789607795.344129:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541085568 00000100:00100000:1.0:1789607795.344132:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541085568 00000100:00100000:1.0:1789607795.344170:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789607795.344180:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541085440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607795.344279:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541085440:12345-0@lo:400:kworker.0 Request processed in 100us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607795.344311:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789607795.344335:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789607795.344341:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541085568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607795.344373:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541085568:12345-0@lo:400:kworker.0 Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607795.344379:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789607795.344472:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541085568:0@lo:400:kworker.0 00000100:00100000:1.0:1789607795.344486:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541085440:0@lo:400:kworker.0 00000100:00100000:2.0:1789607795.344891:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541085312:0@lo:400:kworker.0 00000100:00100000:2.0:1789607795.344939:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607795.344983:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541085824:0@lo:400:kworker.0 00000100:00100000:2.0:1789607795.345008:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607795.345032:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607795.345039:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541085696:0@lo:400:kworker.0 00000100:00100000:2.0:1789607795.345066:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607795.345108:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541085952 00000100:00100000:2.0:1789607795.345113:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541085952 00000100:00100000:2.0:1789607795.345163:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541085696 00000100:00100000:2.0:1789607795.345166:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541085696 00000100:00100000:2.0:1789607795.345205:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789607795.345213:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541085952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607795.345259:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541085952:12345-0@lo:400:kworker.0 Request processed in 47us (1321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607795.345266:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789607795.345281:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789607795.345287:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541085696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607795.345336:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541085696:12345-0@lo:400:kworker.0 Request processed in 49us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607795.345342:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789607795.345363:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541085824 00000100:00100000:2.0:1789607795.345367:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541085824 00000100:00100000:2.0:1789607795.345396:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789607795.345402:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541085824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607795.345471:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541085824:12345-0@lo:400:kworker.0 Request processed in 69us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607795.345478:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:2.0:1789607795.345542:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff39f480 x1876539541085696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607795.345556:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541085696:0@lo:400:kworker.0 00000100:00100000:2.0:1789607795.345568:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541085824:0@lo:400:kworker.0 00000100:00100000:2.0:1789607795.345603:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541085952:0@lo:400:kworker.0 00000100:00080000:2.0:1789607795.345659:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607795.345665:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607795.346106:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541085312 00000100:00100000:1.0:1789607795.346114:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541085312 00000100:00100000:1.0:1789607795.346175:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789607795.346185:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541085312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607795.346264:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541085312:12345-0@lo:400:kworker.0 Request processed in 81us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607795.346271:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789607795.346413:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541085312:0@lo:400:kworker.0 00000100:00100000:0.0:1789607795.851923:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607795.851958:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541086080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607795.852263:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607795.852667:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541086080 00000100:00100000:3.0:1789607795.852679:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541086080 00000100:00100000:3.0:1789607795.852760:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789607795.852771:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541086080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607795.852817:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607795.852882:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541086080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607795.852891:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789607795.853628:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541086080:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789607796.109118:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789607796.162996:0:11675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc83501980 20000000:00000080:1.0:1789607796.163026:0:11675:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a1eeac0c00 uarg=0000000000000000 20000000:01000000:1.0:1789607796.163080:0:11675:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789607796.163088:0:11675:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789607796.163095:0:11675:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789607796.167978:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789607796.168900:0:11675:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789607796.178980:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789607796.179041:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789607796.179097:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789607796.179118:0:11675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789607796.179156:0:11675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.179182:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d103b800/0x33f091d0013860fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b952b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.179202:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1ff4ef800/0x33f091d001386105 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9532 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.179212:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1f558f200/0x33f091d001386113 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138610c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.179220:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1d103a200/0x33f091d001386121 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138611a expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.179228:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1f558e000/0x33f091d00138612f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001386128 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.179237:0:11675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.179288:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1f558e000/0x33f091d00138612f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001386128 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.179307:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1f558e000/0x33f091d00138612f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001386128 expref: 18 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607796.179324:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876539541086208:0@lo:104: 00000100:00100000:1.0:1789607796.179408:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607796.179523:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d103a200/0x33f091d001386121 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d00138611a expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.179542:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1d103a200/0x33f091d001386121 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d00138611a expref: 18 pid: 5841 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607796.179551:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876539541086336:0@lo:104: 00000100:00100000:1.0:1789607796.179574:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607796.179602:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1f558f200/0x33f091d001386113 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d00138610c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.179610:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a1f558f200/0x33f091d001386113 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d00138610c expref: 18 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607796.179619:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876539541086464:0@lo:104: 00000100:00100000:1.0:1789607796.179638:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789607796.179653:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1ff4ef800/0x33f091d001386105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9532 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.179663:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1ff4ef800/0x33f091d001386105 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9532 expref: 12 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607796.179673:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876539541086592:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607796.179729:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1d103b800/0x33f091d0013860fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b952b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.179738:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1d103b800/0x33f091d0013860fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b952b expref: 12 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607796.179746:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876539541086720:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607796.179766:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8eadb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607796.179910:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789607796.179926:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541086208 00000100:00100000:2.0:1789607796.179935:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541086208 00000100:00100000:2.0:1789607796.179979:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541086336 00000100:00100000:2.0:1789607796.179981:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541086336 00000100:00100000:2.0:1789607796.179989:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541086464 00000100:00100000:2.0:1789607796.179991:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541086464 00000100:00100000:2.0:1789607796.180002:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789607796.180012:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:11675:x1876539541086208:12345-0@lo:104: 00010000:00010000:2.0:1789607796.180032:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d00138612f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180093:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789607796.180099:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+5:11675:x1876539541086208:12345-0@lo:104: Request processed in 88us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607796.180106:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789607796.180123:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789607796.180128:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:11675:x1876539541086336:12345-0@lo:104: 00010000:00010000:2.0:1789607796.180135:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001386121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180161:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789607796.180165:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+4:11675:x1876539541086336:12345-0@lo:104: Request processed in 37us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607796.180170:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789607796.180180:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607796.180195:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff531050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:11675:x1876539541086464:12345-0@lo:104: 00010000:00010000:2.0:1789607796.180203:0:5831:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001386113 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180227:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789607796.180231:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff531050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+3:11675:x1876539541086464:12345-0@lo:104: Request processed in 46us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607796.180237:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789607796.180396:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789607796.180404:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d00138612f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180417:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558e800 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607796.180445:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d00138612f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180455:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d00138612f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607796.180462:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d00138612f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607796.180468:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607796.180501:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d00138612f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180508:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607796.180531:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d00138612f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180539:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1f558e800/0x33f091d001386128 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d00138612f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180554:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607796.180557:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001386121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180563:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2a00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607796.180566:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001386121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180582:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001386121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607796.180589:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001386121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607796.180594:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607796.180605:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001386121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180610:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607796.180616:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001386121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180623:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138611a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001386121 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180632:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607796.180635:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001386113 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180641:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efa00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607796.180644:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001386113 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180650:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001386113 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607796.180656:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001386113 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607796.180666:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607796.180693:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001386113 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180699:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607796.180714:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001386113 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180721:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1ff4efa00/0x33f091d00138610c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001386113 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.180735:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607796.180737:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607796.180738:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607796.180745:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607796.180766:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541086848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607796.180800:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607796.180827:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607796.180832:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541086976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607796.180849:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607796.180872:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541087104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607796.180893:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607796.180922:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541086848 00000100:00100000:2.0:1789607796.180927:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541086848 00010000:00010000:2.0:1789607796.180949:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1f558e000/0x33f091d00138612f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001386128 expref: 19 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607796.180970:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541086976 00000100:00100000:2.0:1789607796.180978:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541086976 00010000:00010000:2.0:1789607796.180988:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d103a200/0x33f091d001386121 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d00138611a expref: 20 pid: 5841 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607796.180998:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541087104 00000100:00100000:2.0:1789607796.181000:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541087104 00010000:00010000:2.0:1789607796.181007:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1f558f200/0x33f091d001386113 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d00138610c expref: 21 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607796.181018:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789607796.181023:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+21:3309:x1876539541086848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607796.181034:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607796.181039:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1f558e000/0x33f091d00138612f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001386128 expref: 21 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.181052:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1f558e000/0x33f091d00138612f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001386128 expref: 21 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.181069:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607796.181093:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+21:3309:x1876539541086848:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607796.181100:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789607796.181111:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789607796.181117:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+20:3309:x1876539541086976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607796.181123:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607796.181127:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d103a200/0x33f091d001386121 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d00138611a expref: 20 pid: 5841 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.181135:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d103a200/0x33f091d001386121 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d00138611a expref: 20 pid: 5841 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.181153:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607796.181170:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+20:3309:x1876539541086976:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607796.181176:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789607796.181200:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789607796.181206:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c70850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3311:x1876539541087104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607796.181213:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607796.181217:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1f558f200/0x33f091d001386113 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d00138610c expref: 19 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.181226:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1f558f200/0x33f091d001386113 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d00138610c expref: 19 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607796.181235:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607796.181256:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c70850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3311:x1876539541087104:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607796.181262:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789607796.181328:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541087104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607796.181346:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541086976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607796.181353:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541086848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607796.183406:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1f558e000/0x33f091d00138612f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001386128 expref: 18 pid: 5842 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607796.183716:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876539541086208:0@lo:104: 00010000:00010000:1.0:1789607796.183755:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103a200/0x33f091d001386121 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d00138611a expref: 17 pid: 5841 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607796.183764:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876539541086336:0@lo:104: 00010000:00010000:1.0:1789607796.183776:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1f558f200/0x33f091d001386113 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d00138610c expref: 16 pid: 5839 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607796.183784:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876539541086464:0@lo:104: 00000100:00100000:1.0:1789607796.184413:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876539541086720:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607796.184933:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1876539541086592:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607796.184985:0:11675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607796.185238:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607796.185709:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520079616 00000100:00100000:1.0:1789607796.185720:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520079616 00010000:00010000:1.0:1789607796.185821:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1d103b800/0x33f091d0013860fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b952b expref: 13 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607796.185870:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:1.0:1789607796.185883:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520079616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607796.185907:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607796.185914:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1d103b800/0x33f091d0013860fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b952b expref: 13 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.185950:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1d103b800/0x33f091d0013860fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b952b expref: 13 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.185971:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103b800/0x33f091d0013860fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b952b expref: 13 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.185990:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607796.186065:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:2373:x1876539520079616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 184us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607796.186073:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:2.0:1789607796.189165:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607796.189265:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520079744 00000100:00100000:1.0:1789607796.189279:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520079744 00010000:00010000:1.0:1789607796.189333:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1ff4ef800/0x33f091d001386105 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9532 expref: 12 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607796.189387:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:1.0:1789607796.189399:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:2374:x1876539520079744:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607796.189417:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607796.189472:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1ff4ef800/0x33f091d001386105 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9532 expref: 12 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.189487:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1ff4ef800/0x33f091d001386105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9532 expref: 12 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.189510:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff4ef800/0x33f091d001386105 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9532 expref: 12 pid: 5839 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.189532:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.189563:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.189587:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.189596:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.189603:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.189610:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.189617:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eec00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607796.189623:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.189633:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.189661:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607796.189675:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607796.189743:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:2374:x1876539520079744:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 345us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607796.189752:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00010000:00010000:3.0:1789607796.190227:0:11675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607796.190238:0:11675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607796.190257:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff4eec00/0x33f091d001386263 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607797.136357:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789607797.323605:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607797.323618:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1e8ccd800 from 7 10000000:01000000:2.0:1789607797.323625:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607797.323697:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607797.323733:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607797.323749:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607797.323783:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541087232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.323878:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607797.323961:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873300 going to sleep for 11 seconds 00000100:00100000:3.0:1789607797.324202:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541087232 00000100:00100000:3.0:1789607797.324212:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541087232 00000100:00100000:3.0:1789607797.324284:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789607797.324295:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:5845:x1876539541087232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607797.324312:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607797.324331:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558e200/0x33f091d001386271 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d00138626a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.324362:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558e200/0x33f091d001386271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d00138626a expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.324376:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558e200/0x33f091d001386271 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138626a expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.324456:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e200, rc 0) 00000100:00100000:3.0:1789607797.327162:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541087232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2855us (3270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607797.327190:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789607797.329767:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541087232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607797.329808:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607797.329824:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607797.330521:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541087360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.330616:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607797.330804:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873300 going to sleep for 11 seconds 00000100:00100000:3.0:1789607797.334969:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541087360 00000100:00100000:3.0:1789607797.334991:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541087360 00000100:00100000:3.0:1789607797.335158:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789607797.335172:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541087360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607797.336404:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541087360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1228us (5781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607797.336603:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789607797.336748:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541087360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.336820:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541087488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.336878:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607797.351293:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607797.353935:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541087488 00000100:00100000:1.0:1789607797.353985:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541087488 00000100:00100000:1.0:1789607797.354074:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789607797.354087:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541087488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607797.354445:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541087488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 360us (17566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607797.354637:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789607797.354953:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541087488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.355304:0:11688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:11688:1876539541087616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607797.355364:0:11688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607797.355398:0:11688:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873240 going to sleep for 11 seconds 00000100:00100000:3.0:1789607797.355653:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541087616 00000100:00100000:3.0:1789607797.355662:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541087616 00000100:00100000:3.0:1789607797.355705:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789607797.355715:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:11688:x1876539541087616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607797.355939:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4eebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:11688:x1876539541087616:12345-0@lo:502:llog_process_th.0 Request processed in 225us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607797.355947:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789607797.356312:0:11688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:11688:1876539541087616:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607797.356347:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607797.356359:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607797.356362:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789607797.356371:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99a1e8ccd800 00000020:00000080:2.0:1789607797.356380:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789607797.356660:0:11688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:11688:1876539541087744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607797.356711:0:11688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607797.356755:0:11688:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873240 going to sleep for 11 seconds 00000100:00100000:3.0:1789607797.356779:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541087744 00000100:00100000:3.0:1789607797.356795:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541087744 00000100:00100000:3.0:1789607797.356858:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789607797.356868:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:11688:x1876539541087744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607797.357112:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4eeb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:11688:x1876539541087744:12345-0@lo:502:llog_process_th.0 Request processed in 245us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607797.357121:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789607797.357639:0:11688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:11688:1876539541087744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607797.357676:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607797.357685:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607797.357687:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789607797.357693:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789607797.357840:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789607797.357876:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607797.357888:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.357900:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607797.357911:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789607797.357914:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1c8d84800 from 7 10000000:01000000:3.0:1789607797.357917:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607797.357949:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.357966:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.357978:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607797.357999:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541087872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607797.358041:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607797.358156:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607797.358910:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541087872 00000100:00100000:0.0:1789607797.358924:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541087872 00000100:00100000:2.0:1789607797.359219:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789607797.359234:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:5845:x1876539541087872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607797.359248:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607797.359264:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ff7e2000/0x33f091d00138627f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001386278 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607797.359289:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff7e2000/0x33f091d00138627f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001386278 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607797.359300:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ff7e2000/0x33f091d00138627f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001386278 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607797.359321:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e2000, rc 0) 00000100:00100000:2.0:1789607797.359370:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4ee8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541087872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607797.359377:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789607797.359474:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541087872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607797.359489:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607797.359499:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607797.359568:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541088000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.359601:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607797.359626:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607797.359639:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541088000 00000100:00100000:2.0:1789607797.359644:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541088000 00000100:00100000:2.0:1789607797.359676:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789607797.359682:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541088000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.359971:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541088000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607797.359978:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789607797.360008:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541088000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.360031:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541088128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.360065:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607797.360083:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607797.360094:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541088128 00000100:00100000:2.0:1789607797.360097:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541088128 00000100:00100000:2.0:1789607797.361365:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789607797.361387:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541088128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.361600:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541088128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607797.361607:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789607797.361665:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541088128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.362241:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:11690:1876539541088256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607797.362285:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607797.362308:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541088256 00000100:00100000:2.0:1789607797.362314:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541088256 00000100:00100000:2.0:1789607797.362343:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789607797.362349:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:11690:x1876539541088256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607797.362534:0:11690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff823f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607797.363246:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:11690:x1876539541088256:12345-0@lo:502:llog_process_th.0 Request processed in 894us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607797.363255:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789607797.363347:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:11690:1876539541088256:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789607797.363595:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607797.363605:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607797.363608:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789607797.363620:0:11690:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99a1c8d84800 00000020:00000080:0.0:1789607797.363623:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789607797.363845:0:11690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:11690:1876539541088384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607797.363887:0:11690:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607797.363961:0:11690:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f9133480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607797.366293:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541088384 00000100:00100000:3.0:1789607797.366306:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541088384 00000100:00100000:2.0:1789607797.367061:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789607797.367073:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:11690:x1876539541088384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607797.367366:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:11690:x1876539541088384:12345-0@lo:502:llog_process_th.0 Request processed in 295us (3477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607797.367373:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789607797.368277:0:11690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:11690:1876539541088384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789607797.368314:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607797.368323:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607797.368325:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789607797.368330:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789607797.368520:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789607797.368543:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607797.368554:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.368566:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607797.368577:0:5845:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789607797.368586:0:5845:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1c98a7800 from 7 10000000:01000000:3.0:1789607797.368589:0:5845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607797.368619:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.368627:0:5845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.368637:0:5845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607797.368657:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541088512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607797.368720:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607797.369510:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607797.369569:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541088512 00000100:00100000:0.0:1789607797.369577:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541088512 00000100:00100000:0.0:1789607797.369619:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789607797.369628:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:5845:x1876539541088512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607797.369641:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607797.369658:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103aa00/0x33f091d00138628d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001386286 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607797.369684:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103aa00/0x33f091d00138628d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001386286 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607797.369804:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103aa00/0x33f091d00138628d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001386286 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607797.369815:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103aa00, rc 0) 00000100:00100000:0.0:1789607797.369868:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541088512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607797.369875:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789607797.370516:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541088512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607797.370537:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607797.370549:0:5845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607797.370622:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541088640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607797.370664:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607797.370699:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8ead540 going to sleep for 11 seconds 00000100:00100000:1.0:1789607797.370948:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541088640 00000100:00100000:1.0:1789607797.370955:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541088640 00000100:00100000:1.0:1789607797.370982:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789607797.370990:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541088640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607797.371270:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541088640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607797.371278:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789607797.371318:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541088640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789607797.371350:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541088768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607797.371399:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607797.371415:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8ead540 going to sleep for 11 seconds 00000100:00100000:1.0:1789607797.371450:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541088768 00000100:00100000:1.0:1789607797.371454:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541088768 00000100:00100000:1.0:1789607797.371471:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789607797.371478:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541088768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607797.372272:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:5845:x1876539541088768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 791us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607797.372281:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789607797.375294:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d7ee8c63-baa9-4366-97c9-8054ab743e80:5845:1876539541088768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789607797.377967:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789607797.380857:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:11692:1876539541088896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607797.380932:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607797.380971:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541088896 00000100:00100000:0.0:1789607797.380983:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541088896 00000100:00100000:0.0:1789607797.381025:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789607797.381032:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:11692:x1876539541088896:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607797.381221:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:11692:x1876539541088896:12345-0@lo:502:llog_process_th.0 Request processed in 189us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607797.381233:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789607797.381280:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607797.381299:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:11692:1876539541088896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789607797.381330:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789607797.381380:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789607797.381384:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789607797.381395:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99a1c98a7800 00000020:00000080:0.0:1789607797.381397:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789607797.381497:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:11692:1876539541089024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607797.381528:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607797.381555:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1fadd7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607797.381730:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541089024 00000100:00100000:3.0:1789607797.381735:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541089024 00000100:00100000:3.0:1789607797.381765:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789607797.381773:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:11692:x1876539541089024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607797.381901:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:11692:x1876539541089024:12345-0@lo:502:llog_process_th.0 Request processed in 126us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607797.381908:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789607797.381978:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d7ee8c63-baa9-4366-97c9-8054ab743e80:11692:1876539541089024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607797.381997:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607797.382001:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607797.382003:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789607797.382006:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789607797.382193:0:5845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789607797.382215:0:5845:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607797.382224:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.382235:0:5845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607797.388992:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607797.389016:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541089152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607797.389081:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607797.390755:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541089152 00000100:00100000:3.0:1789607797.390784:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541089152 00000100:00100000:3.0:1789607797.390854:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789607797.390864:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541089152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607797.390909:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607797.390983:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541089152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607797.390990:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789607797.391032:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4ad500 x1876539541089152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607797.391052:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541089152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789607797.394972:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607797.883108:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607797.883216:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520079872 00000100:00100000:0.0:1789607797.883227:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520079872 00000100:00100000:0.0:1789607797.883294:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 268 00000100:00100000:0.0:1789607797.883305:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:5616:x1876539520079872:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789607797.883323:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607797.883344:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103ae00/0x33f091d001386294 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b957f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607797.883374:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103ae00/0x33f091d001386294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b957f expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607797.883387:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103ae00/0x33f091d001386294 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b957f expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607797.883414:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103ae00, rc 0) 00000100:00100000:0.0:1789607797.883508:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:5616:x1876539520079872:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 196us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607797.883516:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 268 00000100:00100000:0.0:1789607797.890143:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607797.890390:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520080000 00000100:00100000:2.0:1789607797.890401:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520080000 00000100:00100000:2.0:1789607797.890487:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 269 00000100:00100000:2.0:1789607797.890508:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:5616:x1876539520080000:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.890840:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:5616:x1876539520080000:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 343us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607797.890849:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 269 00000100:00100000:2.0:1789607797.898029:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607797.898216:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520080128 00000100:00100000:3.0:1789607797.898227:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520080128 00000100:00100000:3.0:1789607797.898281:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 270 00000100:00100000:3.0:1789607797.898292:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:5616:x1876539520080128:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607797.898561:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8835450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:5616:x1876539520080128:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 270us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607797.898570:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 270 00000100:00100000:3.0:1789607797.904089:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607797.904208:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520080256 00000100:00100000:0.0:1789607797.904219:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520080256 00000100:00100000:0.0:1789607797.904278:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 271 00000100:00100000:0.0:1789607797.904288:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:9987:x1876539520080256:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607797.904606:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:9987:x1876539520080256:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 318us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607797.904615:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 271 00000100:00100000:0.0:1789607797.924561:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607797.924693:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520080384 00000100:00100000:2.0:1789607797.924712:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520080384 00000100:00100000:2.0:1789607797.924769:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 272 00000100:00100000:2.0:1789607797.924779:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:9987:x1876539520080384:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607797.925026:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8837850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:9987:x1876539520080384:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 247us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607797.925034:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 272 00000100:00100000:2.0:1789607797.928947:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607797.929332:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520080512 00000100:00100000:3.0:1789607797.929342:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520080512 00000100:00100000:3.0:1789607797.929398:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 273 00000100:00100000:3.0:1789607797.929408:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:5616:x1876539520080512:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607797.929464:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607797.929484:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558e400/0x33f091d00138629b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9586 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.929601:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558e400/0x33f091d00138629b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9586 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.929612:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558e400/0x33f091d00138629b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9586 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607797.929622:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e400, rc 0) 00000100:00100000:3.0:1789607797.929670:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8834850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:5616:x1876539520080512:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 263us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607797.929676:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 273 00000100:00100000:3.0:1789607797.935462:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607797.935746:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520080640 00000100:00100000:0.0:1789607797.935757:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520080640 00000100:00100000:0.0:1789607797.935818:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 274 00000100:00100000:0.0:1789607797.935829:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:5616:x1876539520080640:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789607797.936468:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8836450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:5616:x1876539520080640:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 638us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607797.936477:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 274 00000100:00100000:0.0:1789607797.952361:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607797.953687:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520080768 00000100:00100000:2.0:1789607797.953708:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520080768 00000100:00100000:2.0:1789607797.953779:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 275 00000100:00100000:2.0:1789607797.953790:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:5616:x1876539520080768:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607797.954257:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:5616:x1876539520080768:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 467us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607797.954266:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 275 00000100:00100000:2.0:1789607797.968784:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607797.968882:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520080896 00000100:00100000:0.0:1789607797.968892:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520080896 00000100:00100000:0.0:1789607797.968945:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 276 00000100:00100000:0.0:1789607797.968955:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:9990:x1876539520080896:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607797.969272:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:9990:x1876539520080896:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 317us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607797.969281:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 276 00000100:00100000:0.0:1789607797.975847:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607797.976191:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520081024 00000100:00100000:2.0:1789607797.976201:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520081024 00000100:00100000:2.0:1789607797.976294:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 277 00000100:00100000:2.0:1789607797.976304:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:9990:x1876539520081024:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607797.976591:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:9990:x1876539520081024:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 287us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607797.976601:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 277 00010000:00010000:2.0:1789607798.155741:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607798.412269:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789607799.181585:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607799.606821:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607799.606876:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607799.606917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607799.606956:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607799.606992:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520081280 00000100:00100000:2.0:1789607799.607002:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520081280 00000100:00100000:2.0:1789607799.607064:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520081536 00000100:00100000:2.0:1789607799.607068:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520081536 00000100:00100000:2.0:1789607799.607092:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:2.0:1789607799.607116:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520081280:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607799.607353:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520081152 00000100:00100000:3.0:1789607799.607358:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520081152 00000100:00100000:3.0:1789607799.607401:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 278 00000100:00100000:3.0:1789607799.607409:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2375:x1876539520081152:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607799.607493:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2375:x1876539520081152:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 85us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607799.607499:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 278 00000100:00100000:3.0:1789607799.607647:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:3.0:1789607799.607655:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2376:x1876539520081536:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607799.607687:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2376:x1876539520081536:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 34us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607799.607694:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00080000:3.0:1789607799.607711:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607799.608798:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520081280:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 1679us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607799.608827:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:1.0:1789607799.609326:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520081408 00000100:00100000:1.0:1789607799.609334:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520081408 00000100:00100000:1.0:1789607799.609403:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:1.0:1789607799.609413:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520081408:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607799.609503:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520081408:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 92us (2585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607799.609510:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00080000:3.0:1789607799.610107:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789607800.022640:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1789607800.205177:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607800.460471:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541089664:0@lo:400:kworker.0 00000100:00100000:0.0:1789607800.460568:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607800.460655:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607800.460662:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541089536:0@lo:400:kworker.0 00000100:00100000:0.0:1789607800.460691:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607800.460832:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541089664 00000100:00100000:0.0:1789607800.460843:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541089664 00000100:00100000:0.0:1789607800.460914:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789607800.460924:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541089664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607800.460986:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541089664:12345-0@lo:400:kworker.0 Request processed in 63us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607800.460994:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1789607800.461212:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a201b4b100 x1876539541089664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607800.461230:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541089664:0@lo:400:kworker.0 00000100:00100000:1.0:1789607800.461470:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541089408:0@lo:400:kworker.0 00000100:00100000:1.0:1789607800.461512:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607800.461549:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541089920:0@lo:400:kworker.0 00000100:00100000:1.0:1789607800.461574:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607800.461609:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789607800.461616:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541089280:0@lo:400:kworker.0 00000100:00100000:1.0:1789607800.461664:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607800.461686:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541089792:0@lo:400:kworker.0 00000100:00100000:1.0:1789607800.461707:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607800.461739:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541089920 00000100:00100000:1.0:1789607800.461744:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541089920 00000100:00100000:1.0:1789607800.461783:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789607800.461792:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541089920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607800.461835:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541089920:12345-0@lo:400:kworker.0 Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607800.461841:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789607800.461863:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541089536 00000100:00100000:1.0:1789607800.461867:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541089536 00000100:00100000:1.0:1789607800.461896:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541089408 00000100:00100000:1.0:1789607800.461899:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541089408 00000100:00100000:1.0:1789607800.461917:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541089792 00000100:00100000:1.0:1789607800.461920:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541089792 00000100:00100000:1.0:1789607800.461935:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789607800.461941:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541089536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607800.461981:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541089536:12345-0@lo:400:kworker.0 Request processed in 40us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607800.461987:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789607800.461998:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789607800.462003:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541089408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607800.462031:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541089408:12345-0@lo:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607800.462037:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789607800.462048:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789607800.462059:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541089792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607800.462087:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541089792:12345-0@lo:400:kworker.0 Request processed in 29us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607800.462092:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789607800.462134:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541089536:0@lo:400:kworker.0 00000100:00100000:1.0:1789607800.462174:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541089792:0@lo:400:kworker.0 00000100:00100000:1.0:1789607800.462183:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541089408:0@lo:400:kworker.0 00000100:00100000:1.0:1789607800.462191:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1789607800.462197:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a1ff4ae300, transno 4294967300 00000100:00100000:1.0:1789607800.462206:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541089920:0@lo:400:kworker.0 00000100:00100000:2.0:1789607800.462381:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541089280 00000100:00100000:2.0:1789607800.462386:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541089280 00000100:00100000:2.0:1789607800.462417:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789607800.462442:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541089280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607800.462483:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541089280:12345-0@lo:400:kworker.0 Request processed in 59us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607800.462489:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789607800.462949:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541089280:0@lo:400:kworker.0 00000100:00080000:1.0:1789607800.462991:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607800.462999:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789607800.463002:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607800.972060:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607800.972102:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541090048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607800.972210:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607800.972508:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541090048 00000100:00100000:3.0:1789607800.972519:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541090048 00000100:00100000:3.0:1789607800.972602:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789607800.972615:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541090048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607800.972662:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607800.972737:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541090048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607800.972745:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789607800.972846:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541090048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789607801.227722:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607802.252827:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607802.507984:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607802.508014:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541090176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607802.508094:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607802.508214:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541090176 00000100:00100000:3.0:1789607802.508232:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541090176 00000100:00100000:3.0:1789607802.508331:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607802.508400:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541090176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607802.508484:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607802.508579:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541090176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607802.508589:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1789607802.508669:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4aed80 x1876539541090176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607802.508691:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541090176:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789607802.508904:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789607803.275883:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607804.301325:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607804.722707:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607804.722756:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607804.722801:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607804.722843:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607804.722882:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520081920 00000100:00100000:0.0:1789607804.722883:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520081664 00000100:00100000:3.0:1789607804.722895:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520081920 00000100:00100000:0.0:1789607804.722895:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520081664 00000100:00100000:3.0:1789607804.722957:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:0.0:1789607804.722957:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 280 00000100:00100000:0.0:1789607804.722968:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2376:x1876539520081664:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607804.722969:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520081920:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607804.723052:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2376:x1876539520081664:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607804.723061:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 280 00000100:00080000:0.0:1789607804.723145:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607804.723171:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520081792 00000100:00100000:1.0:1789607804.723176:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520081792 00000100:00100000:1.0:1789607804.723220:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520082048 00000100:00080000:0.0:1789607804.723221:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607804.723223:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520082048 00000100:00100000:0.0:1789607804.723245:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:1.0:1789607804.723251:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 119 00000100:00100000:0.0:1789607804.723253:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520081792:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607804.723257:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2376:x1876539520082048:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607804.723836:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520081920:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 866us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607804.723844:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00080000:3.0:1789607804.723896:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607804.731602:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520081792:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 8328us (8889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607804.731621:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:1.0:1789607804.739356:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2376:x1876539520082048:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 16079us (16579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607804.739398:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 119 00010000:00010000:0.0:1789607805.323683:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607805.579817:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541090688:0@lo:400:kworker.0 00000100:00100000:0.0:1789607805.579896:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607805.579953:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607805.579959:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541090560:0@lo:400:kworker.0 00000100:00100000:0.0:1789607805.579980:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607805.580010:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541090560 00000100:00100000:0.0:1789607805.580017:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541090560 00000100:00100000:0.0:1789607805.580082:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789607805.580091:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541090560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607805.580145:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541090560:12345-0@lo:400:kworker.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607805.580163:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789607805.580202:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541090560:0@lo:400:kworker.0 00000100:00100000:2.0:1789607805.580415:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541090304:0@lo:400:kworker.0 00000100:00100000:2.0:1789607805.580465:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607805.580503:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541090816:0@lo:400:kworker.0 00000100:00100000:2.0:1789607805.580522:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607805.580536:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789607805.580541:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541090432:0@lo:400:kworker.0 00000100:00100000:2.0:1789607805.580560:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607805.580574:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541090944:0@lo:400:kworker.0 00000100:00100000:2.0:1789607805.580593:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607805.580619:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541090688 00000100:00100000:2.0:1789607805.580623:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541090688 00000100:00100000:2.0:1789607805.580650:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541090944 00000100:00100000:2.0:1789607805.580659:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541090944 00000100:00100000:2.0:1789607805.580684:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789607805.580691:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541090688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607805.580725:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541090688:12345-0@lo:400:kworker.0 Request processed in 35us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607805.580731:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789607805.580744:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789607805.580749:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541090944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607805.580779:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541090944:12345-0@lo:400:kworker.0 Request processed in 30us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607805.580784:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789607805.580958:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541090304 00000100:00100000:0.0:1789607805.580963:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541090304 00000100:00100000:0.0:1789607805.580989:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789607805.580995:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541090304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607805.581026:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541090304:12345-0@lo:400:kworker.0 Request processed in 32us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607805.581031:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789607805.581138:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541090944:0@lo:400:kworker.0 00000100:00100000:2.0:1789607805.581146:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541090304:0@lo:400:kworker.0 00000100:00100000:2.0:1789607805.581189:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541090816 00000100:00100000:2.0:1789607805.581193:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541090816 00000100:00100000:2.0:1789607805.581213:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541090432 00000100:00100000:2.0:1789607805.581216:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541090432 00000100:00100000:2.0:1789607805.581230:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789607805.581235:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541090816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607805.581266:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541090816:12345-0@lo:400:kworker.0 Request processed in 31us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607805.581271:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789607805.581282:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789607805.581287:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541090432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607805.581307:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541090432:12345-0@lo:400:kworker.0 Request processed in 21us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607805.581322:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789607805.581346:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541090432:0@lo:400:kworker.0 00000100:00100000:2.0:1789607805.581355:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541090816:0@lo:400:kworker.0 00010000:00080000:2.0:1789607805.581394:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a201b49c00 x1876539541090688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607805.581407:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541090688:0@lo:400:kworker.0 00000100:00080000:3.0:1789607805.582775:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607805.582782:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607805.582785:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607806.092441:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541091072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607806.092528:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607806.092798:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541091072 00000100:00100000:1.0:1789607806.092807:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541091072 00000100:00100000:1.0:1789607806.092867:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789607806.092877:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541091072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789607806.092913:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607806.093198:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541091072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 321us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607806.093205:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789607806.093302:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541091072:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789607806.347697:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607807.371617:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607807.627769:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541091200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607807.627846:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607807.630200:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541091200 00000100:00100000:1.0:1789607807.630215:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541091200 00000100:00100000:1.0:1789607807.630299:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789607807.630310:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541091200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607807.630349:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789607807.630487:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607807.633492:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541091200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3174us (5636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607807.633508:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1789607807.634347:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4ad500 x1876539541091200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607807.634373:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541091200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789607808.395981:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607808.652321:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789607809.419590:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607809.843522:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607809.843584:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607809.843696:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520082304 00000100:00100000:0.0:1789607809.843707:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520082304 00000100:00100000:0.0:1789607809.843791:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 123 00000100:00100000:0.0:1789607809.843803:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2374:x1876539520082304:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607809.843874:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2374:x1876539520082304:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 73us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607809.843893:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 123 00000100:00100000:2.0:1789607809.844013:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520082176 00000100:00100000:2.0:1789607809.844019:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520082176 00000100:00100000:2.0:1789607809.844087:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 282 00000100:00100000:2.0:1789607809.844097:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2374:x1876539520082176:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607809.844125:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2374:x1876539520082176:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 31us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607809.844131:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 282 00000100:00080000:3.0:1789607809.844334:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607809.855483:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607809.856133:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520082432 00000100:00100000:2.0:1789607809.856163:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520082432 00000100:00100000:2.0:1789607809.856250:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:2.0:1789607809.856262:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2372:x1876539520082432:12345-192.168.202.3@tcp:9:kworker.0 00000020:00000080:2.0:1789607809.856292:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d0013861d7 00000100:00080000:2.0:1789607809.856301:0:6692:0:(import.c:65:import_set_state_nolock()) ffff99a1e4ce5800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789607809.856530:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789607809.856675:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607809.856818:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607809.857014:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520082560 00000100:00100000:0.0:1789607809.857019:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520082560 00000100:00100000:0.0:1789607809.857085:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 124 00000100:00100000:0.0:1789607809.857093:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520082560:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607809.857165:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520082560:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 73us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607809.857173:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 124 00000001:00000004:2.0:1789607809.857388:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:3.0:1789607809.858242:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607809.859266:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+2:2372:x1876539520082432:12345-192.168.202.3@tcp:9:kworker.0 Request processed in 2875us (3664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607809.859294:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000001:00100000:0.0:1789607810.276843:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000020:00000080:0.0:1789607810.276859:0:7651:0:(genops.c:885:class_export_put()) final put ffff99a1ffa5e000/d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000020:00000080:1.0:1789607810.277131:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1ffa5e000/d0d9aceb-01dc-4deb-add2-cd492a0443a6 for lustre-OST0001 00000020:00000080:1.0:1789607810.277205:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1e4ce5800 for lustre-OST0001 00010000:00010000:0.0:1789607810.444024:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607810.701698:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541091584:0@lo:400:kworker.0 00000100:00100000:3.0:1789607810.701797:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607810.701889:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607810.701896:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541091712:0@lo:400:kworker.0 00000100:00100000:3.0:1789607810.701925:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607810.701985:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541091712 00000100:00100000:3.0:1789607810.702008:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541091712 00000100:00100000:3.0:1789607810.702095:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789607810.702107:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541091712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607810.702165:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541091712:12345-0@lo:400:kworker.0 Request processed in 60us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607810.702172:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789607810.702199:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789607810.702232:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1d0d11880 x1876539541091712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607810.702249:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541091712:0@lo:400:kworker.0 00000100:00100000:0.0:1789607810.702459:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541091328:0@lo:400:kworker.0 00000100:00100000:0.0:1789607810.702518:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607810.702561:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541091840:0@lo:400:kworker.0 00000100:00100000:0.0:1789607810.702586:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607810.702609:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789607810.702615:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541091456:0@lo:400:kworker.0 00000100:00100000:0.0:1789607810.702637:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607810.702655:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541091968:0@lo:400:kworker.0 00000100:00100000:0.0:1789607810.702677:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607810.702711:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541091584 00000100:00100000:0.0:1789607810.702716:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541091584 00000100:00100000:0.0:1789607810.702755:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541091840 00000100:00100000:0.0:1789607810.702758:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541091840 00000100:00100000:0.0:1789607810.702779:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541091456 00000100:00100000:0.0:1789607810.702781:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541091456 00000100:00100000:0.0:1789607810.702817:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789607810.702823:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541091584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607810.702863:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541091584:12345-0@lo:400:kworker.0 Request processed in 40us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607810.702870:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789607810.702884:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789607810.702890:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541091840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607810.702919:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541091840:12345-0@lo:400:kworker.0 Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607810.702925:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789607810.702936:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789607810.702957:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541091456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607810.702984:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541091456:12345-0@lo:400:kworker.0 Request processed in 29us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607810.703000:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789607810.703026:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541091968 00000100:00100000:0.0:1789607810.703029:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541091968 00000100:00100000:0.0:1789607810.703073:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789607810.703081:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541091968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607810.703112:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541091968:12345-0@lo:400:kworker.0 Request processed in 33us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607810.703119:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1789607810.703146:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607810.703150:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607810.703172:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541091456:0@lo:400:kworker.0 00000100:00100000:0.0:1789607810.703182:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541091968:0@lo:400:kworker.0 00000100:00100000:0.0:1789607810.703201:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541091840:0@lo:400:kworker.0 00000100:00100000:0.0:1789607810.703230:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541091584:0@lo:400:kworker.0 00000100:00100000:3.0:1789607810.703892:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541091328 00000100:00100000:3.0:1789607810.703900:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541091328 00000100:00100000:3.0:1789607810.703958:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789607810.703976:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541091328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607810.704235:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541091328:12345-0@lo:400:kworker.0 Request processed in 261us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607810.704244:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789607810.704460:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541091328:0@lo:400:kworker.0 00000100:00100000:0.0:1789607811.213591:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541092096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607811.213701:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607811.213998:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541092096 00000100:00100000:3.0:1789607811.214010:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541092096 00000100:00100000:3.0:1789607811.214092:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789607811.214104:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541092096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607811.214156:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607811.214223:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541092096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607811.214231:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789607811.216070:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541092096:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789607811.468519:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607812.491673:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607812.748082:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607812.748118:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541092224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607812.748214:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607812.748399:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541092224 00000100:00100000:3.0:1789607812.748412:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541092224 00000100:00100000:3.0:1789607812.748536:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789607812.748549:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541092224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607812.748598:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607812.748702:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541092224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607812.748709:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1789607812.748868:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4b9880 x1876539541092224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607812.748918:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541092224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607812.749074:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789607813.515726:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607814.539970:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607814.960554:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607814.960688:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520082688 00000100:00100000:0.0:1789607814.960701:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520082688 00000100:00100000:0.0:1789607814.960770:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 284 00000100:00100000:0.0:1789607814.960782:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2374:x1876539520082688:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607814.960963:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2374:x1876539520082688:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 183us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607814.960971:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 284 00000100:00100000:3.0:1789607814.962675:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607814.962770:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607814.963023:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520082816 00000100:00100000:0.0:1789607814.963038:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520082816 00000100:00080000:3.0:1789607814.963190:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607814.963235:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520082944 00000100:00100000:0.0:1789607814.963239:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520082944 00000100:00080000:3.0:1789607814.963299:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607814.963485:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 128 00000100:00100000:1.0:1789607814.963500:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2374:x1876539520082816:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607814.963646:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2374:x1876539520082816:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 150us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607814.963655:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 128 00000100:00100000:1.0:1789607814.963678:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 129 00000100:00100000:1.0:1789607814.963686:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520082944:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607814.963712:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520082944:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 27us (942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607814.963718:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 129 00010000:00010000:1.0:1789607815.566713:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607815.820461:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541092608:0@lo:400:kworker.0 00000100:00100000:1.0:1789607815.820461:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541092480:0@lo:400:kworker.0 00000100:00100000:0.0:1789607815.820556:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541092352:0@lo:400:kworker.0 00000100:00100000:2.0:1789607815.820741:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541092736:0@lo:400:kworker.0 00000100:00100000:3.0:1789607815.824736:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607815.824991:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541092608 00000100:00100000:3.0:1789607815.825013:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541092608 00000100:00100000:3.0:1789607815.825095:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789607815.825109:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541092608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607815.826270:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607815.826356:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541092992:0@lo:400:kworker.0 00000100:00100000:1.0:1789607815.826420:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607815.826501:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607815.826513:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541092864:0@lo:400:kworker.0 00000100:00100000:1.0:1789607815.826548:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607815.826845:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541092992 00000100:00100000:1.0:1789607815.826854:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541092992 00000100:00100000:1.0:1789607815.826933:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789607815.826942:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541092992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607815.826987:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541092992:12345-0@lo:400:kworker.0 Request processed in 46us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607815.826988:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541092608:12345-0@lo:400:kworker.0 Request processed in 1882us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607815.826994:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789607815.827009:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789607815.827024:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541092480 00000100:00100000:3.0:1789607815.827028:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541092480 00000100:00100000:1.0:1789607815.827030:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541092864 00000100:00100000:1.0:1789607815.827033:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541092864 00000100:00100000:3.0:1789607815.827053:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789607815.827056:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789607815.827059:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541092480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607815.827062:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541092864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607815.827088:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541092480:12345-0@lo:400:kworker.0 Request processed in 30us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607815.827088:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541092864:12345-0@lo:400:kworker.0 Request processed in 27us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607815.827094:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789607815.827097:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1789607815.827112:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607815.827116:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607815.827138:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541092864:0@lo:400:kworker.0 00000100:00100000:1.0:1789607815.827153:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541092992:0@lo:400:kworker.0 00000100:00100000:3.0:1789607815.827154:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541092608:0@lo:400:kworker.0 00000100:00100000:1.0:1789607815.827163:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541092480:0@lo:400:kworker.0 00000100:00100000:0.0:1789607815.827306:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607815.827733:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607815.827792:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541092352 00000100:00100000:3.0:1789607815.827798:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541092352 00000100:00100000:3.0:1789607815.827837:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789607815.827846:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541092352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607815.827897:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541092352:12345-0@lo:400:kworker.0 Request processed in 53us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607815.827903:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789607815.828079:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541092352:0@lo:400:kworker.0 00000100:00100000:0.0:1789607815.835812:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541092736 00000100:00100000:0.0:1789607815.835849:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541092736 00000100:00100000:0.0:1789607815.835964:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789607815.835977:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541092736:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789607815.836142:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607815.836245:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541092736:12345-0@lo:400:kworker.0 Request processed in 270us (8511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607815.836254:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1789607815.838970:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1d0d10e00 x1876539541092736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607815.838997:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541092736:0@lo:400:kworker.0 00000100:00100000:2.0:1789607816.332971:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607816.333005:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541093120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607816.333109:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607816.333309:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541093120 00000100:00100000:3.0:1789607816.333321:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541093120 00000100:00100000:3.0:1789607816.333401:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789607816.333412:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541093120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607816.333487:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607816.333542:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541093120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607816.333550:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789607816.333827:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541093120:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789607816.611288:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607817.614454:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607817.867673:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541093248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607817.868231:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607817.868319:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541093248 00000100:00100000:2.0:1789607817.868329:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541093248 00000100:00100000:2.0:1789607817.868408:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789607817.868419:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541093248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607817.868840:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607817.868912:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541093248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 493us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607817.868920:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1789607817.868975:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789607817.869265:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4b8700 x1876539541093248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607817.869536:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541093248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789607818.640267:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607818.893086:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789607819.659665:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607820.081535:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607820.081579:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607820.081616:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607820.081659:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520083328 00000100:00100000:1.0:1789607820.081672:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520083328 00000100:00100000:3.0:1789607820.081691:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520083200 00000100:00100000:3.0:1789607820.081699:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520083200 00000100:00100000:0.0:1789607820.081777:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520083072 00000100:00100000:0.0:1789607820.081783:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520083072 00000100:00100000:0.0:1789607820.081829:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 286 00000100:00100000:0.0:1789607820.081841:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2375:x1876539520083072:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607820.081933:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2375:x1876539520083072:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 93us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607820.081942:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 286 00000100:00080000:0.0:1789607820.082012:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607820.082087:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 133 00000100:00100000:1.0:1789607820.082106:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2375:x1876539520083328:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607820.082142:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2375:x1876539520083328:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 38us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607820.082149:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 133 00000100:00100000:3.0:1789607820.085507:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 134 00000100:00100000:3.0:1789607820.085539:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520083200:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607820.085669:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520083200:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 146us (4050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607820.085678:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 134 00000001:02000400:1.0:1789607820.622278:0:11866:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 21:16:59 (1789607819) 00010000:00010000:3.0:1789607820.684577:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607820.940290:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541093504:0@lo:400:kworker.0 00000100:00100000:1.0:1789607820.940369:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607820.940459:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541094016:0@lo:400:kworker.0 00000100:00100000:1.0:1789607820.940559:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607820.940817:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541093504 00000100:00100000:0.0:1789607820.940827:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541093504 00000100:00100000:0.0:1789607820.940879:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789607820.940889:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541093504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607820.940941:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541093504:12345-0@lo:400:kworker.0 Request processed in 54us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607820.940960:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789607820.941003:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541093760:0@lo:400:kworker.0 00000100:00100000:1.0:1789607820.941201:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541093504:0@lo:400:kworker.0 00000100:00100000:1.0:1789607820.941217:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789607820.941225:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541093376:0@lo:400:kworker.0 00000100:00100000:1.0:1789607820.941255:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607820.941278:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541093888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607820.941300:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607820.941330:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541094016 00000100:00100000:1.0:1789607820.941335:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541094016 00000100:00100000:1.0:1789607820.941375:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789607820.941381:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541094016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607820.941416:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541094016:12345-0@lo:400:kworker.0 Request processed in 35us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607820.941447:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789607820.941468:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541093376 00000100:00100000:1.0:1789607820.941471:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541093376 00000100:00100000:0.0:1789607820.941588:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607820.941610:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607820.941616:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541093632:0@lo:400:kworker.0 00000100:00100000:0.0:1789607820.941654:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607820.941686:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541093888 00000100:00100000:0.0:1789607820.941689:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541093888 00000100:00100000:0.0:1789607820.941713:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541093632 00000100:00100000:0.0:1789607820.941716:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541093632 00000100:00100000:0.0:1789607820.941733:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789607820.941738:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541093888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607820.941766:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541093888:12345-0@lo:400:kworker.0 Request processed in 28us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607820.941896:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541093760 00000100:00100000:3.0:1789607820.941901:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541093760 00000100:00100000:3.0:1789607820.941933:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789607820.941940:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541093760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607820.941992:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541093760:12345-0@lo:400:kworker.0 Request processed in 53us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607820.941999:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1789607820.942097:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607820.942103:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607820.942105:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607820.942171:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789607820.942178:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541093376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607820.942210:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541093376:12345-0@lo:400:kworker.0 Request processed in 33us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607820.942216:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00080000:2.0:1789607820.942332:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a201b4aa00 x1876539541093760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789607836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607820.942355:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541093760:0@lo:400:kworker.0 00000100:00100000:0.0:1789607820.942402:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789607820.945589:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789607820.945630:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541093632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607820.945740:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541093632:12345-0@lo:400:kworker.0 Request processed in 122us (4085us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607820.945747:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789607820.945845:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541093632:0@lo:400:kworker.0 00000100:00100000:1.0:1789607820.948880:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541093376:0@lo:400:kworker.0 00000100:00100000:1.0:1789607820.948899:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541093888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607820.948911:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541094016:0@lo:400:kworker.0 00000100:00100000:2.0:1789607821.451993:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607821.452091:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541094144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607821.452236:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607821.452520:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541094144 00000100:00100000:3.0:1789607821.452529:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541094144 00000100:00100000:3.0:1789607821.452589:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789607821.452599:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541094144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607821.452634:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607821.452691:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541094144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607821.452697:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789607821.453005:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541094144:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789607821.707764:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607822.509672:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607822.511418:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520083456 00000100:00100000:0.0:1789607822.511478:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520083456 00000100:00100000:0.0:1789607822.511599:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:0.0:1789607822.511612:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:10260:x1876539520083456:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607822.511632:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607822.511654:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013862a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b958d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.511714:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013862a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.511727:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013862a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.511740:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013862a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607822.512044:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607822.512049:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607822.512109:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013862a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.512147:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013862a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b958d expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.512166:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013862a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b958d expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.512174:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:0.0:1789607822.512177:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607822.512181:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103bc00, rc 0) 00000100:00100000:0.0:1789607822.512254:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:10260:x1876539520083456:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 646us (2597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607822.512261:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00080000:3.0:1789607822.514017:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607822.523950:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607822.524176:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520083584 00000100:00100000:1.0:1789607822.524189:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520083584 00000100:00100000:1.0:1789607822.524276:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:1.0:1789607822.524296:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:10261:x1876539520083584:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607822.524324:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607822.524355:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d0013862b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9594 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.524667:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013862b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.524686:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013862b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.524699:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013862b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.524715:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d0013862be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.524745:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d0013862be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.524752:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d0013862be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.525247:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eea00/0x33f091d0013862c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.525366:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eea00/0x33f091d0013862c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.525375:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eea00/0x33f091d0013862c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607822.525416:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789607822.525420:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607822.525447:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eea00/0x33f091d0013862c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528131:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013862b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528154:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013862b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528163:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013862b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528170:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607822.528174:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013862b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528207:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013862b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528227:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:1.0:1789607822.528231:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607822.528237:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013862b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528243:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013862b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528278:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d0013862be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528293:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d0013862be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528300:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d0013862be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528305:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607822.528308:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d0013862be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528315:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d0013862be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528323:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99a1dab7d100) 00010000:00010000:1.0:1789607822.528326:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607822.528329:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d0013862be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528347:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d0013862be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528479:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d0013862b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9594 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528499:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eea00/0x33f091d0013862c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9594 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607822.528507:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99a1dab7d000) 00010000:00010000:1.0:1789607822.528510:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607822.528513:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4eea00, rc 0) 00000100:00100000:1.0:1789607822.528614:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:10261:x1876539520083584:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 4319us (4690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607822.528625:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:2.0:1789607822.554694:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607822.555048:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520083840 00000100:00100000:0.0:1789607822.555059:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520083840 00000100:00100000:0.0:1789607822.555124:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:0.0:1789607822.555135:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:10261:x1876539520083840:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607822.555156:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607822.555175:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013862cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b959b expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.555246:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862d3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.555260:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.555398:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.555563:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.555573:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.555581:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.556218:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013862e1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.556231:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013862e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.556239:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013862e1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607822.556250:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789607822.556661:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.556671:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862d3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.556678:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.556684:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607822.556698:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.556706:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862d3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.556720:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99a1dab7d000) 00010000:00010000:0.0:1789607822.556724:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607822.556729:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.556736:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.556749:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.556755:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862da lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.557342:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.557349:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607822.557353:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.557359:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862da lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.557369:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99a1f911dc00) 00010000:00010000:0.0:1789607822.557371:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607822.557383:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862da lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.557390:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862da lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.561667:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013862cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b959b expref: 10 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.561694:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013862e1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b959b expref: 9 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607822.561703:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1f911d000) 00010000:00010000:0.0:1789607822.561706:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607822.561710:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b800, rc 0) 00000100:00100000:0.0:1789607822.561797:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:10261:x1876539520083840:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 6662us (7113us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789607822.561806:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:3.0:1789607822.573515:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607822.573634:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520083968 00000100:00100000:1.0:1789607822.573651:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520083968 00000100:00100000:1.0:1789607822.573729:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:1.0:1789607822.573741:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:10261:x1876539520083968:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789607822.573879:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:10261:x1876539520083968:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 Request processed in 140us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607822.573886:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 35 00010000:00010000:3.0:1789607822.732481:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789607822.988295:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789607822.990816:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607822.990847:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541094272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607822.990951:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607822.991045:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541094272 00000100:00100000:3.0:1789607822.991055:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541094272 00000100:00080000:2.0:1789607822.991296:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607822.995677:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789607822.995704:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541094272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607822.995763:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607822.995877:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541094272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (4925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607822.995886:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1789607822.995965:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4b9880 x1876539541094272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607822.995993:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541094272:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789607823.756831:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607824.784250:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607824.838087:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607824.841373:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520084096 00000100:00100000:0.0:1789607824.841397:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520084096 00000100:00100000:0.0:1789607824.841682:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:0.0:1789607824.841696:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:10304:x1876539520084096:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607824.841722:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607824.841750:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95a2 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.841844:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.841861:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.841873:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.841890:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013862fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.841897:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013862fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.841904:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013862fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842170:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842179:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842197:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842203:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607824.842207:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842216:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842230:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:0.0:1789607824.842233:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607824.842239:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842245:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013862f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842257:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013862fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842263:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013862fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842269:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013862fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842273:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607824.842276:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013862fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842291:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013862fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842299:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99a1f911dc00) 00010000:00010000:0.0:1789607824.842302:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607824.842305:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013862fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842311:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013862fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842351:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95a2 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842363:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:0.0:1789607824.842366:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607824.842369:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013862ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95a2 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.842382:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a200, rc 0) 00000100:00100000:0.0:1789607824.842501:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:10304:x1876539520084096:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 808us (4429us total) trans 0 rc 301/301 00000100:00100000:0.0:1789607824.842511:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00080000:2.0:1789607824.846460:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607824.851233:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607824.851325:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520084352 00000100:00100000:3.0:1789607824.851362:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520084352 00000100:00100000:3.0:1789607824.851447:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:3.0:1789607824.851457:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:10304:x1876539520084352:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1789607824.851534:0:11489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607824.851569:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013862a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b958d expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607824.851595:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607824.851614:0:11489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607824.851898:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386304 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607824.851925:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386304 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607824.851939:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386304 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607824.851954:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138630b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607824.851962:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138630b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607824.851969:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138630b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607824.853011:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789607824.853031:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386304 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607824.853042:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386304 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607824.853057:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386304 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607824.853064:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607824.853069:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386304 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607824.853078:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386304 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607824.853093:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c3982a00) 00010000:00010000:3.0:1789607824.853096:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607824.853101:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386304 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607824.853108:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386304 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607824.853129:0:11489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071dffa69 reply state 000000008b5d557c transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138630b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607824.853139:0:11489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607824.853298:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:10304:x1876539520084352:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 1837us (2075us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789607824.853309:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00010000:00010000:0.0:1789607824.867530:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138630b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.867551:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138630b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.867575:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138630b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.867582:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607824.867587:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138630b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.867596:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138630b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.867617:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99a1c3982300) 00010000:00010000:0.0:1789607824.867621:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607824.867628:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138630b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607824.867634:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138630b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607824.993988:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607824.994546:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520084480 00000100:00100000:2.0:1789607824.994561:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520084480 00000100:00100000:2.0:1789607824.994656:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:2.0:1789607824.994670:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:10312:x1876539520084480:12345-192.168.202.3@tcp:101:lctl.0 00010000:00010000:2.0:1789607824.994705:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607824.994738:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386312 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95a9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607824.994820:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386319 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607824.994838:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607824.994854:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607824.994899:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607824.994904:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607824.994963:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386319 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607824.995017:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386312 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95a9 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607824.995039:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386319 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95a9 expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607824.995048:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1db790800) 00010000:00010000:2.0:1789607824.995051:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607824.995055:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3e00, rc 0) 00000100:00100000:2.0:1789607824.995145:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:10312:x1876539520084480:12345-192.168.202.3@tcp:101:lctl.0 Request processed in 479us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607824.995153:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:1.0:1789607825.057631:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607825.057749:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520084608 00000100:00100000:3.0:1789607825.057763:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520084608 00000100:00100000:3.0:1789607825.057878:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:3.0:1789607825.057892:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:10318:x1876539520084608:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1789607825.057940:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607825.057969:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386320 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95b0 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058077:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386327 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058096:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386327 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058110:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386327 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058127:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138632e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058135:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138632e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058141:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138632e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058284:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f200/0x33f091d001386335 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058293:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f200/0x33f091d001386335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058301:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f200/0x33f091d001386335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607825.058345:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789607825.058356:0:11489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607825.058407:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f200/0x33f091d001386335 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058462:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386327 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058471:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386327 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058479:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386327 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058485:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558ee00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607825.058490:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386327 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058499:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386327 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058512:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1db790800) 00010000:00010000:3.0:1789607825.058516:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607825.058522:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386327 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058529:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386327 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058545:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138632e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058552:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138632e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058569:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138632e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058575:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607825.058578:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138632e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058584:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138632e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058634:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99a1c3982a00) 00010000:00010000:3.0:1789607825.058638:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607825.058642:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138632e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058649:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138632e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058687:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386320 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95b0 expref: 12 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058703:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f200/0x33f091d001386335 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95b0 expref: 11 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.058711:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:3.0:1789607825.058713:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789607825.058716:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f200, rc 0) 00000100:00100000:3.0:1789607825.058806:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:10318:x1876539520084608:12345-192.168.202.3@tcp:101:bash.0 Request processed in 917us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607825.058823:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:2.0:1789607825.070237:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.070864:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520084864 00000100:00100000:0.0:1789607825.072893:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520084864 00000100:00100000:0.0:1789607825.073018:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:0.0:1789607825.073354:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:10318:x1876539520084864:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1789607825.073388:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607825.073418:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138633c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95b7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.073601:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386343 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.073643:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386343 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.073658:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386343 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.073678:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138634a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.073686:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138634a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.073693:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138634a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789607825.083802:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789607825.084316:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386351 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.084340:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.084358:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386351 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.084410:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386343 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.084419:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386343 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.084468:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386343 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.084491:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607825.084497:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386343 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.084505:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386343 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.084521:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:0.0:1789607825.084525:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607825.084531:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386343 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.084537:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386343 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607825.084553:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c70bc9a9 reply state 00000000855e03ff transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138634a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607825.084564:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789607825.084612:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138633c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95b7 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.084629:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95b7 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.084636:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911de00) 00010000:00010000:0.0:1789607825.084639:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607825.084641:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a200, rc 0) 00000100:00100000:0.0:1789607825.084742:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:10318:x1876539520084864:12345-192.168.202.3@tcp:101:bash.0 Request processed in 11712us (14525us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789607825.084758:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 40 00010000:00010000:1.0:1789607825.086624:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138634a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.086642:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138634a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.086649:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138634a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.086655:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607825.086660:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138634a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.086668:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138634a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.086685:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1f911dc00) 00010000:00010000:1.0:1789607825.086688:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607825.086692:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138634a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.086699:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138634a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607825.098670:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607825.098900:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520084992 00000100:00100000:1.0:1789607825.098922:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520084992 00000100:00100000:1.0:1789607825.099631:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:1.0:1789607825.099643:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2372:x1876539520084992:12345-192.168.202.3@tcp:8:bash.0 00010000:00080000:0.0:1789607825.099759:0:6695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:0.0:1789607825.099801:0:6695:0:(genops.c:1384:class_connect()) connect: client d0d9aceb-01dc-4deb-add2-cd492a0443a6, cookie 0x33f091d00138635f 00002000:00100000:0.0:1789607825.099818:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d0d9aceb-01dc-4deb-add2-cd492a0443a6/ffff99a201b25800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789607825.099850:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789607825.100941:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789607825.101698:0:6695:0:(import.c:65:import_set_state_nolock()) ffff99a201b21800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607825.101874:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2372:x1876539520084992:12345-192.168.202.3@tcp:8:bash.0 Request processed in 2227us (3216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607825.101887:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:2.0:1789607825.105793:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607825.105921:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520085120 00000100:00100000:3.0:1789607825.105935:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520085120 00000100:00100000:0.0:1789607825.106243:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:0.0:1789607825.106259:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:0:x1876539520085120:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1789607825.106284:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607825.106315:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa636189/0x33f091d001386366 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95be expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607825.106386:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607825.106415:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=358s v=(0 0) 00010000:00010000:0.0:1789607825.106463:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607825.106476:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa636189/0x33f091d001386366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95be expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.106502:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa636189/0x33f091d001386366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95be expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.106535:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a400, rc 0) 00000100:00100000:0.0:1789607825.106600:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:0:x1876539520085120:12345-192.168.202.3@tcp:101:bash.0 Request processed in 346us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607825.106607:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00080000:2.0:1789607825.106823:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607825.109545:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607825.110065:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520085248 00000100:00100000:3.0:1789607825.110079:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520085248 00000100:00100000:3.0:1789607825.110151:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:3.0:1789607825.110299:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:10318:x1876539520085248:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1789607825.110371:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607825.110398:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95c5 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.110451:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa636189/0x33f091d001386366 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95be expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.110462:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607825.110467:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607825.110471:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 8 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.110512:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa636189/0x33f091d001386366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95be expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.110524:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa636189/0x33f091d001386366 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95be expref: 8 pid: 6692 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607825.110536:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201654700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8471:1876539541094400:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607825.110660:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e89d8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607825.113044:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201654700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8471:1876539541094400:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607825.113094:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 8 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.113116:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558fc00, rc 0) 00000100:00100000:3.0:1789607825.113182:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:10318:x1876539520085248:12345-192.168.202.3@tcp:101:bash.0 Request processed in 3021us (3647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607825.113193:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:3.0:1789607825.114972:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607825.115306:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520085376 00000100:00100000:2.0:1789607825.115320:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520085376 00010000:00010000:2.0:1789607825.115376:0:8517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa636189/0x33f091d001386366 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95be expref: 8 pid: 6692 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607825.115512:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:2.0:1789607825.115525:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2373:x1876539520085376:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607825.115546:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607825.115576:0:8517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa636189/0x33f091d001386366 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95be expref: 8 pid: 6692 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.115619:0:8517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa636189/0x33f091d001386366 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95be expref: 8 pid: 6692 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.115646:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa636189/0x33f091d001386366 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95be expref: 8 pid: 6692 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.115662:0:8517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607825.115666:0:8517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607825.115673:0:8517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 7 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.115682:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 7 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.115731:0:8517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 7 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607825.115749:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8517:1876539541094528:192.168.202.3@tcp:105: 00000100:00100000:2.0:1789607825.115862:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789607825.120045:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607825.120155:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8517:1876539541094528:192.168.202.3@tcp:105: 00010000:00010000:2.0:1789607825.120184:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607825.120266:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2373:x1876539520085376:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 4743us (5302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607825.120280:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:3.0:1789607825.120391:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520085632 00000100:00100000:3.0:1789607825.120401:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520085632 00000100:00100000:3.0:1789607825.120496:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:3.0:1789607825.120508:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:10318:x1876539520085632:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:3.0:1789607825.121269:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:10318:x1876539520085632:12345-192.168.202.3@tcp:35:bash.0 Request processed in 759us (1236us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789607825.121279:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:3.0:1789607825.200636:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607825.200718:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.200836:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520085760 00000100:00100000:0.0:1789607825.200849:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520085760 00000100:00100000:0.0:1789607825.200966:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 288 00000100:00100000:0.0:1789607825.200990:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520085760:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607825.201229:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520085760:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 250us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607825.201238:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 288 00000100:00100000:2.0:1789607825.201467:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520085888 00000100:00100000:2.0:1789607825.201473:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520085888 00000100:00100000:2.0:1789607825.201531:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 138 00000100:00100000:2.0:1789607825.201540:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520085888:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607825.201582:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520085888:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 44us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607825.201589:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 138 00000100:00080000:0.0:1789607825.201813:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607825.203127:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.204483:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520086144 00000100:00100000:0.0:1789607825.204497:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520086144 00000100:00100000:0.0:1789607825.204563:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:0.0:1789607825.204571:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:10328:x1876539520086144:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607825.204767:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607825.204793:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386374 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95cc expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607825.204959:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789607825.205217:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386374 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95cc expref: 16 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.205258:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1db790800) 00010000:00010000:0.0:1789607825.205262:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607825.205269:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386374 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95cc expref: 16 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.205283:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103bc00, rc 0) 00000100:00100000:0.0:1789607825.205410:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:10328:x1876539520086144:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 839us (2290us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1789607825.205418:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:1.0:1789607825.208932:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607825.216217:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520086400 00000100:00100000:2.0:1789607825.216238:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520086400 00000100:00100000:2.0:1789607825.216335:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:2.0:1789607825.216348:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:10328:x1876539520086400:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1789607825.217186:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:10328:x1876539520086400:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 835us (8271us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789607825.217197:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1789607825.291706:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.292933:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520086528 00000100:00100000:0.0:1789607825.292955:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520086528 00000100:00100000:0.0:1789607825.293321:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:0.0:1789607825.293336:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:10334:x1876539520086528:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607825.293372:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607825.293404:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386382 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95d3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.293726:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386389 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.293746:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.293763:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607825.294346:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789607825.294373:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607825.294402:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386389 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.294544:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386382 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95d3 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.294573:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386389 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95d3 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.294583:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:0.0:1789607825.294586:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607825.294591:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a400, rc 0) 00000100:00100000:0.0:1789607825.294754:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+17:10334:x1876539520086528:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1420us (3065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607825.294766:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:3.0:1789607825.299740:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607825.300089:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520086784 00000100:00100000:1.0:1789607825.300105:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520086784 00000100:00100000:1.0:1789607825.300182:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:1.0:1789607825.300194:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+17:10334:x1876539520086784:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607825.300224:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607825.300256:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386390 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95da expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.300405:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386397 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.300573:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.300666:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386397 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607825.300685:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789607825.301145:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386390 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95da expref: 20 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.301172:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386397 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95da expref: 19 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.301182:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911de00) 00010000:00010000:1.0:1789607825.301186:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607825.301191:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4eee00, rc 0) 00000100:00100000:1.0:1789607825.301313:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201656680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:10334:x1876539520086784:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1120us (1589us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789607825.301343:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:1.0:1789607825.306610:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.306769:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520087040 00000100:00100000:0.0:1789607825.306792:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520087040 00000100:00100000:0.0:1789607825.307061:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:0.0:1789607825.307076:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:10334:x1876539520087040:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607825.307111:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607825.307143:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013863a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95e1 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.307279:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013863ac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.307298:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013863ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.307333:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013863ac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607825.307350:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789607825.307556:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013863a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95e1 expref: 22 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.307577:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013863ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95e1 expref: 21 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.308105:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911de00) 00010000:00010000:0.0:1789607825.308109:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789607825.308113:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a000, rc 0) 00000100:00100000:0.0:1789607825.308272:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:10334:x1876539520087040:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1199us (1688us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789607825.308282:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:1.0:1789607825.312261:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607825.314188:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520087168 00000100:00100000:2.0:1789607825.314209:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520087168 00000100:00100000:2.0:1789607825.314325:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:2.0:1789607825.314339:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:2374:x1876539520087168:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607825.314360:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607825.314393:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386397 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95da expref: 21 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.314455:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911de00) 00010000:00010000:2.0:1789607825.314464:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607825.314556:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:2374:x1876539520087168:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 220us (2311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607825.314584:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:1.0:1789607825.319051:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.320081:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520087296 00000100:00100000:0.0:1789607825.320099:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520087296 00000100:00100000:0.0:1789607825.320172:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:0.0:1789607825.320185:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520087296:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1789607825.320267:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.320296:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 7 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.320311:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789607825.320338:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607825.320344:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.320408:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 7 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.320454:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 7 pid: 8471 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607825.320475:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1876539541094656:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607825.320610:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8d9df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607825.324025:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee725c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1876539541094656:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607825.324065:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607825.328697:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.328943:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520087424 00000100:00100000:0.0:1789607825.328963:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520087424 00002000:00100000:0.0:1789607825.329032:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff99a1ff418a80 x1876539520087424/t0(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:381/0 lens 504/0 e 0 to 0 dl 1789607836 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789607825.329044:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1ff418a80 with x1876539520087424 ext(0->12) 00010000:00010000:0.0:1789607825.329059:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 8 pid: 8471 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.329152:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 8 pid: 8471 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607825.329187:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99a1ff418a80 00000100:00100000:0.0:1789607825.329345:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:0.0:1789607825.329358:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520087424:12345-192.168.202.3@tcp:4:lfs.0 00000001:00100000:3.0:1789607825.438813:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000100:00100000:1.0:1789607825.439726:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2374:x1876539520087424:12345-192.168.202.3@tcp:4:lfs.0 Request processed in 110360us (111032us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789607825.439746:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00002000:00100000:1.0:1789607825.439762:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff99a1ff418a80 x1876539520087424/t4294967299(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:381/0 lens 504/448 e 0 to 0 dl 1789607836 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789607825.439773:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1ff418a80 with x1876539520087424 ext(0->12) 00010000:00010000:1.0:1789607825.439858:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 9 pid: 8471 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.439881:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 9 pid: 8471 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607825.439891:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99a1ff418a80 00000100:00100000:3.0:1789607825.443520:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607825.443672:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520087552 00000100:00100000:1.0:1789607825.443686:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520087552 00010000:00010000:1.0:1789607825.443741:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 9 pid: 8471 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607825.443806:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:1.0:1789607825.443818:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201656d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2373:x1876539520087552:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607825.443859:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789607825.443886:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789607825.443889:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789607825 00002000:00010000:1.0:1789607825.443892:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789607825 00002000:00010000:1.0:1789607825.443895:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789607825 00010000:00010000:1.0:1789607825.443903:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 9 pid: 8471 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.443929:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 9 pid: 8471 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.443965:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a08b2f11/0x33f091d00138636d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95c5 expref: 9 pid: 8471 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.443988:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607825.443994:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607825.444001:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.444012:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.444054:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607825.444096:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.444106:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607825.444127:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201656d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2373:x1876539520087552:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 311us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607825.444135:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 36 00010000:00010000:0.0:1789607825.444137:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.444145:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.444153:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.444161:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b000 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607825.444166:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.444177:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.444203:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.444212:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b81b8ae/0x33f091d0013863ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607825.444267:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520087296:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 124085us (125229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607825.444276:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:3.0:1789607825.446966:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607825.447481:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520087808 00000100:00100000:2.0:1789607825.447496:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520087808 00000100:00100000:2.0:1789607825.447562:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:2.0:1789607825.447574:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:10334:x1876539520087808:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:2.0:1789607825.447676:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013863ac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95e1 expref: 20 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607825.448071:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789607825.448135:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789607825.448813:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789607825.448889:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.448922:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386351 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95b7 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.448934:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.448983:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386351 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95b7 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.449001:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386351 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95b7 expref: 24 pid: 5847 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607825.449021:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5850:1876539541094784:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607825.449159:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789607825.454643:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.454796:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520087936 00000100:00100000:0.0:1789607825.454810:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520087936 00010000:00010000:0.0:1789607825.454873:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386351 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95b7 expref: 25 pid: 5847 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607825.454946:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:0.0:1789607825.454957:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+25:2374:x1876539520087936:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607825.454976:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607825.454984:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386351 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95b7 expref: 25 pid: 5847 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.455000:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386351 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95b7 expref: 25 pid: 5847 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.455030:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911de00) 00010000:00010000:0.0:1789607825.455037:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.455067:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.455077:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.455102:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607825.455180:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+25:2374:x1876539520087936:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 223us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607825.455189:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00010000:00010000:2.0:1789607825.455991:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386351 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95b7 expref: 24 pid: 5847 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607825.456014:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5850:1876539541094784:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607825.456040:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.456050:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.456057:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607825.456221:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789607825.456936:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1789607825.457109:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1876539541094912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789607825.457333:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607825.457391:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789607825.457452:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541094912 00000100:00100000:1.0:1789607825.457463:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541094912 00000100:00100000:1.0:1789607825.457552:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607825.457562:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876539541094912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789607825.457667:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876539541094912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607825.457675:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607825.457745:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1876539541094912:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1789607825.458663:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789607825.458842:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1789607825.459051:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffad4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1876539541095040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789607825.459126:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607825.459191:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e89d86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607825.459250:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541095040 00000100:00100000:2.0:1789607825.459257:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541095040 00000100:00100000:2.0:1789607825.459346:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607825.459358:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1876539541095040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789607825.459583:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1876539541095040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 227us (461us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789607825.459602:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607825.459671:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffad4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1876539541095040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789607825.459737:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1789607825.459776:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.459787:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.459795:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.459801:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607825.459805:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.459812:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.459828:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911de00) 00010000:00010000:3.0:1789607825.459831:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789607825.459836:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.459843:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013863c1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789607825.460026:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789607825.460255:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789607825.460266:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359304842901ns, next at 360304841099ns, rc = 0 00000001:00080000:3.0:1789607825.460282:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1789607825.460314:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911de00) 00010000:00010000:3.0:1789607825.460318:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789607825.460325:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d0013863ac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95e1 expref: 28 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607825.460450:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:10334:x1876539520087808:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 12851us (13471us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1789607825.460459:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000020:00080000:3.0:1789607825.460463:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789607825.463898:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.463987:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520088064 00000100:00100000:0.0:1789607825.463997:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520088064 00000100:00100000:0.0:1789607825.464056:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:0.0:1789607825.464066:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:10334:x1876539520088064:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607825.464089:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607825.464113:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013863c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95e8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.464172:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013863c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95e8 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.464188:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013863c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95e8 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.464208:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:0.0:1789607825.464211:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607825.464227:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103bc00, rc 0) 00000100:00100000:0.0:1789607825.464351:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:10334:x1876539520088064:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 286us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607825.464358:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:1.0:1789607825.475073:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.475183:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520088320 00000100:00100000:0.0:1789607825.475193:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520088320 00000100:00100000:0.0:1789607825.475301:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:0.0:1789607825.475312:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1db76e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:10334:x1876539520088320:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1789607825.475576:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1db76e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:10334:x1876539520088320:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 264us (513us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789607825.475584:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:0.0:1789607825.607515:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607825.607716:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520088576 00000100:00100000:3.0:1789607825.607728:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520088576 00000100:00100000:3.0:1789607825.607804:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:3.0:1789607825.607815:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:10344:x1876539520088576:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607825.607840:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607825.607879:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013863cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95ef expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607825.607984:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789607825.608241:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013863cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95ef expref: 31 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.608256:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1db790800) 00010000:00010000:3.0:1789607825.608259:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607825.608264:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013863cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95ef expref: 31 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607825.608296:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f800, rc 0) 00000100:00100000:3.0:1789607825.608368:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:10344:x1876539520088576:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 554us (872us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1789607825.608375:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:3.0:1789607825.611801:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.615777:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520088704 00000100:00100000:0.0:1789607825.615794:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520088704 00000100:00100000:1.0:1789607825.617251:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:1.0:1789607825.617263:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:10344:x1876539520088704:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:1.0:1789607825.617336:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d0013863dd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617353:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d0013863dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617365:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d0013863dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617380:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013863e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617387:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013863e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617393:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013863e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617721:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d0013863eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617752:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d0013863eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617759:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d0013863eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607825.617805:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d0013863eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617817:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d0013863dd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617823:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d0013863dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617830:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d0013863dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617837:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607825.617841:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d0013863dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617858:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d0013863dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617870:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:1.0:1789607825.617873:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607825.617878:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d0013863dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617884:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d0013863dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617915:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013863e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617923:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013863e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617928:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013863e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617934:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efe00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607825.617937:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013863e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617943:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013863e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617951:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1dab7d100) 00010000:00010000:1.0:1789607825.617954:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607825.617957:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013863e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617963:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013863e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617978:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d0013863eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617983:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d0013863eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.617988:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d0013863eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.618001:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eee00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607825.618003:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d0013863eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.618009:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d0013863eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.618017:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:1.0:1789607825.618019:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607825.618021:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d0013863eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.618026:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d0013863eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607825.618108:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:10344:x1876539520088704:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 845us (6318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607825.618117:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 47 00000001:00080000:3.0:1789607825.637938:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967326 is committed 00000020:00080000:3.0:1789607825.638019:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a1ee72ae40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789607825.638025:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1ff982b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a1ee72a900 00000020:00080000:3.0:1789607825.638030:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1ff982500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a1eeaf8000 00000020:00080000:2.0:1789607825.638066:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000004:00080000:3.0:1789607825.638074:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789607825.638261:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789607825.638282:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541095168:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789607825.639851:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607825.640070:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607825.640140:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541095168 00000100:00100000:1.0:1789607825.640149:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541095168 00000100:00100000:1.0:1789607825.640212:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789607825.640222:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876539541095168:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789607825.640251:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789607825.640285:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aab3f91, atime: 0x6aab3f91, ctime: 0x6aab3f91, blocks: 0x1 00010000:00010000:1.0:1789607825.640292:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054fa4137/0x33f091d0013863f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.640309:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=359s v=(0 0) 00010000:00010000:1.0:1789607825.640404:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607825.640411:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054fa4137/0x33f091d0013863f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.640456:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054fa4137/0x33f091d0013863f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.640467:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054fa4137/0x33f091d0013863f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.640476:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054fa4137/0x33f091d0013863f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.640499:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607825.640539:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607825.640555:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054fa4137/0x33f091d0013863f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.640569:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee600 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607825.640574:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054fa4137/0x33f091d0013863f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.640587:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054fa4137/0x33f091d0013863f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607825.640670:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520088960 00000100:00100000:3.0:1789607825.640676:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520088960 00010000:00010000:2.0:1789607825.640719:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054fa4137/0x33f091d0013863f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.640730:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054fa4137/0x33f091d0013863f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.640762:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607825.640764:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607825.640766:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607825.641979:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1876539541095168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1751us (2125us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789607825.641997:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789607825.641998:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:3.0:1789607825.642026:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+12:10344:x1876539520088960:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1789607825.642268:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:10344:x1876539520088960:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 257us (2201us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789607825.642276:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000004:00080000:1.0:1789607825.642387:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a1c8d9aa00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789607825.642394:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541095168:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789607825.683582:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.683964:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520089216 00000100:00100000:0.0:1789607825.684347:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520089216 00000100:00100000:0.0:1789607825.684492:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:0.0:1789607825.684505:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:10347:x1876539520089216:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607825.684542:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607825.684938:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d0013863f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95f6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.685260:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386400 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.685280:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386400 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.685295:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386400 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.685313:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386407 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.685321:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.685328:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.685923:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d00138640e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.685935:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d00138640e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.685942:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d00138640e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607825.685955:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789607825.686761:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386400 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.686774:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386400 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.686793:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386400 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.686799:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2c00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607825.686805:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386400 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.686814:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386400 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.686829:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:2.0:1789607825.686832:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607825.686838:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386400 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.686921:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386400 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.686940:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386407 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.686947:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386407 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.686954:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.686960:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3a00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607825.686964:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386407 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.687116:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386407 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.687125:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1db790900) 00010000:00010000:2.0:1789607825.687128:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607825.687131:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386407 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.687138:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386407 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.687209:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d0013863f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95f6 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.687227:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d00138640e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95f6 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607825.687236:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:2.0:1789607825.687239:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607825.687242:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3c00, rc 0) 00000100:00100000:2.0:1789607825.687420:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:10347:x1876539520089216:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2916us (3850us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789607825.687482:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:2.0:1789607825.691162:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607825.691258:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520089344 00000100:00100000:0.0:1789607825.691271:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520089344 00000100:00100000:0.0:1789607825.691384:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:0.0:1789607825.691397:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:10347:x1876539520089344:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:0.0:1789607825.691517:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138641c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.691540:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138641c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.691575:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138641c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.691708:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138641c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.691716:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138641c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.691724:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138641c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.691730:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607825.691735:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138641c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.691743:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138641c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.691757:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:0.0:1789607825.691760:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607825.691765:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138641c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607825.691771:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138641c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607825.691860:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:10347:x1876539520089344:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 466us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607825.691869:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:2.0:1789607825.694273:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607825.694350:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520089600 00000100:00100000:3.0:1789607825.694362:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520089600 00000100:00100000:3.0:1789607825.694500:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:3.0:1789607825.694512:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:10347:x1876539520089600:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1789607825.694863:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:10347:x1876539520089600:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 352us (604us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789607825.694871:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00010000:00010000:1.0:1789607825.804298:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607825.979512:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607825.979994:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520089856 00000100:00100000:1.0:1789607825.980010:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520089856 00000100:00100000:1.0:1789607825.980223:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:1.0:1789607825.980237:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:10378:x1876539520089856:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1789607825.980473:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607825.980500:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386423 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b95fd expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.980750:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d00138642a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.980788:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d00138642a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.980801:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d00138642a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607825.980815:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789607825.981013:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386423 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95fd expref: 19 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.981642:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d00138642a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95fd expref: 18 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607825.981654:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:1.0:1789607825.981657:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607825.981662:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4efe00, rc 0) 00000100:00100000:1.0:1789607825.981951:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:10378:x1876539520089856:12345-192.168.202.3@tcp:101:cat.0 Request processed in 1715us (2453us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789607825.981961:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:3.0:1789607825.987216:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607825.987272:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607825.987347:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520089984 00000100:00100000:1.0:1789607825.987361:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520089984 00000100:00100000:1.0:1789607825.987463:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:1.0:1789607825.987475:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c72450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:2374:x1876539520089984:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607825.987717:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789607825.987750:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520090240 00010000:00010000:1.0:1789607825.987752:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d00138642a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95fd expref: 18 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607825.987771:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520090240 00010000:00010000:1.0:1789607825.987793:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:1.0:1789607825.987799:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607825.987804:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:0.0:1789607825.987811:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:10378:x1876539520090240:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:0.0:1789607825.990346:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:10378:x1876539520090240:12345-192.168.202.3@tcp:35:cat.0 Request processed in 2515us (3054us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789607825.990364:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:1.0:1789607825.993096:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c72450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:2374:x1876539520089984:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5604us (5875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607825.993749:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:1.0:1789607826.059841:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541095296:0@lo:400:kworker.0 00000100:00100000:1.0:1789607826.059973:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607826.060060:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541095808:0@lo:400:kworker.0 00000100:00100000:1.0:1789607826.060094:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607826.060261:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607826.060269:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541095680:0@lo:400:kworker.0 00000100:00100000:1.0:1789607826.060299:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607826.060464:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541095296 00000100:00100000:3.0:1789607826.060475:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541095296 00000100:00100000:3.0:1789607826.060544:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789607826.060555:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541095296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607826.060625:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541095296:12345-0@lo:400:kworker.0 Request processed in 72us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607826.060633:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789607826.061287:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541095680 00000100:00100000:2.0:1789607826.061294:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541095680 00000100:00100000:1.0:1789607826.061613:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541095808 00000100:00100000:1.0:1789607826.061618:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541095808 00000100:00100000:1.0:1789607826.061664:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789607826.061673:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541095808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607826.061745:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541095808:12345-0@lo:400:kworker.0 Request processed in 73us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607826.061752:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789607826.061804:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541095296:0@lo:400:kworker.0 00000100:00100000:1.0:1789607826.061822:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541095808:0@lo:400:kworker.0 00000100:00100000:2.0:1789607826.061931:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789607826.061942:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541095680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607826.061990:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541095680:12345-0@lo:400:kworker.0 Request processed in 52us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607826.061996:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789607826.062038:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541095680:0@lo:400:kworker.0 00000100:00100000:0.0:1789607826.062140:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541095424:0@lo:400:kworker.0 00000100:00100000:0.0:1789607826.062184:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607826.062229:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607826.062237:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541095552:0@lo:400:kworker.0 00000100:00100000:0.0:1789607826.062261:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607826.062303:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541095424 00000100:00100000:0.0:1789607826.062308:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541095424 00000100:00100000:0.0:1789607826.062728:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541095552 00000100:00100000:0.0:1789607826.062734:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541095552 00000100:00100000:0.0:1789607826.062763:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789607826.062770:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541095424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607826.062817:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541095424:12345-0@lo:400:kworker.0 Request processed in 47us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607826.062824:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789607826.062837:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789607826.062851:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541095552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607826.062879:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541095552:12345-0@lo:400:kworker.0 Request processed in 30us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607826.062884:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789607826.062926:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541095552:0@lo:400:kworker.0 00000100:00100000:0.0:1789607826.062953:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541095424:0@lo:400:kworker.0 00000100:00080000:3.0:1789607826.063959:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789607826.063969:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607826.064574:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607826.064673:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520090496 00000100:00100000:3.0:1789607826.064683:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520090496 00000100:00100000:3.0:1789607826.064792:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:3.0:1789607826.064802:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:10384:x1876539520090496:12345-192.168.202.3@tcp:101:dd.0 00010000:00010000:3.0:1789607826.064832:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607826.064837:0:6790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789607826.064876:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386389 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95d3 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.064911:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:3.0:1789607826.064918:0:6790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607826.064937:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386438 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9604 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.065086:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.065419:0:6790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d00138640e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95f6 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.065489:0:6790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.065546:0:6790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d00138640e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95f6 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.065564:0:6790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d00138640e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95f6 expref: 18 pid: 5847 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607826.065580:0:6790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6790:1876539541095936:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607826.065684:0:6790:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873300 going to sleep for 11 seconds 00000100:00080000:2.0:1789607826.067961:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607826.072609:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607826.072935:0:6790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6790:1876539541095936:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607826.072980:0:6790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607826.073246:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520090624 00000100:00100000:0.0:1789607826.073257:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520090624 00010000:00010000:0.0:1789607826.073307:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d00138640e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95f6 expref: 19 pid: 5847 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607826.073781:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:0.0:1789607826.073794:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:2374:x1876539520090624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607826.073813:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607826.073822:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d00138640e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95f6 expref: 19 pid: 5847 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.073838:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d00138640e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95f6 expref: 19 pid: 5847 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.073877:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d00138640e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95f6 expref: 19 pid: 5847 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.073896:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:0.0:1789607826.073910:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.073922:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.073931:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.073989:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607826.074075:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:2374:x1876539520090624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 283us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607826.074083:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00010000:00010000:3.0:1789607826.075469:0:6790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.075487:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607826.075514:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789607826.075775:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386438 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9604 expref: 19 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.075798:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9604 expref: 18 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.075808:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:3.0:1789607826.075812:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789607826.075815:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558ee00, rc 0) 00000100:00100000:3.0:1789607826.075899:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:10384:x1876539520090496:12345-192.168.202.3@tcp:101:dd.0 Request processed in 11098us (11479us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789607826.075918:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:2.0:1789607826.083933:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607826.084047:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520090880 00000100:00100000:0.0:1789607826.084062:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520090880 00000100:00100000:0.0:1789607826.084312:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:0.0:1789607826.084331:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:10384:x1876539520090880:12345-192.168.202.3@tcp:36:dd.0 00010000:00010000:0.0:1789607826.084933:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138644d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.084955:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138644d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.084969:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138644d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607826.085033:0:11489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1789607826.085062:0:11489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d53a1cfc reply state 000000009900aa50 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138644d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607826.085073:0:11489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789607826.085776:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:10384:x1876539520090880:12345-192.168.202.3@tcp:36:dd.0 Request processed in 1448us (1854us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789607826.085786:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 52 00000020:00080000:0.0:1789607826.085793:0:11489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789607826.090045:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138644d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.090071:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138644d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.090080:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138644d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.090088:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607826.090095:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138644d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.090117:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138644d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.090138:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:3.0:1789607826.090141:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607826.090163:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138644d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.090171:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138644d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607826.328208:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607826.329528:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520091008 00000100:00100000:1.0:1789607826.329546:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520091008 00000100:00100000:1.0:1789607826.329653:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:1.0:1789607826.329686:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:10398:x1876539520091008:12345-192.168.202.3@tcp:101:stat.0 00010000:00010000:1.0:1789607826.329724:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607826.329752:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386454 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b960b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.329845:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d00138645b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.329863:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d00138645b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.329880:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d00138645b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.329909:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.329917:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.329925:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.330299:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.330315:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9604 expref: 21 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.330325:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386469 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.330381:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9604 expref: 21 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.330398:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9604 expref: 21 pid: 6790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607826.330414:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff418000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541096064:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607826.330610:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff4bf900 going to sleep for 11 seconds 00000100:00100000:0.0:1789607826.340306:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607826.342768:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520091264 00000100:00100000:3.0:1789607826.342789:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520091264 00000100:00100000:3.0:1789607826.342889:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:3.0:1789607826.342913:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:5614:x1876539520091264:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789607826.343382:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:5614:x1876539520091264:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 482us (3091us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789607826.343392:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1789607826.344045:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff418000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541096064:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607826.344080:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607826.346002:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607826.346135:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520091392 00000100:00100000:0.0:1789607826.346148:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520091392 00010000:00010000:0.0:1789607826.346219:0:8517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9604 expref: 23 pid: 6790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607826.346269:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:0.0:1789607826.346279:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:2373:x1876539520091392:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607826.346298:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607826.346306:0:8517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9604 expref: 23 pid: 6790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.346320:0:8517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9604 expref: 23 pid: 6790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.346347:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138643f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9604 expref: 23 pid: 6790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.346368:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:0.0:1789607826.346374:0:8517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386469 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.346880:0:8517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.346894:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386469 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.346945:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607826.347203:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:2373:x1876539520091392:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 741us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607826.347215:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 39 00010000:00010000:2.0:1789607826.347574:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.347595:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607826.347656:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789607826.347661:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607826.347716:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.347733:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386469 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.347745:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d00138645b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.347752:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d00138645b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.347766:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d00138645b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.347773:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eee00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607826.347778:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d00138645b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.347786:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d00138645b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.347800:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:2.0:1789607826.347804:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607826.347809:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d00138645b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.347815:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d00138645b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.347833:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.347838:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386462 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.347953:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.348044:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607826.348048:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.348067:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386462 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.348076:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1dab7d100) 00010000:00010000:2.0:1789607826.348078:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607826.348082:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386462 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.348087:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.348139:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386454 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b960b expref: 22 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.348155:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386469 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b960b expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.348163:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:2.0:1789607826.348166:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607826.348168:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee800, rc 0) 00000100:00100000:2.0:1789607826.348271:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:10398:x1876539520091008:12345-192.168.202.3@tcp:101:stat.0 Request processed in 18588us (20079us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607826.348281:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:2.0:1789607826.415540:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607826.415944:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520091648 00000100:00100000:3.0:1789607826.415959:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520091648 00000100:00100000:3.0:1789607826.416036:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00100000:3.0:1789607826.416049:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:10404:x1876539520091648:12345-192.168.202.3@tcp:36:truncate.0 00010000:00010000:3.0:1789607826.416991:0:6790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607826.417034:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386469 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b960b expref: 21 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.417075:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:3.0:1789607826.417083:0:6790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607826.417559:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386470 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.417577:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.417588:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607826.417673:0:6790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1789607826.417704:0:6790:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c38762b0 reply state 0000000031d8af36 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607826.417713:0:6790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607826.418320:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:10404:x1876539520091648:12345-192.168.202.3@tcp:36:truncate.0 Request processed in 2268us (2791us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789607826.418330:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 54 00000020:00080000:3.0:1789607826.418338:0:6790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789607826.426675:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.426701:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.426710:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.426718:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607826.426725:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.426803:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386470 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.426827:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:1.0:1789607826.426855:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607826.426862:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386470 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.426868:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386470 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607826.565046:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607826.565204:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520091776 00000100:00100000:0.0:1789607826.565219:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520091776 00000100:00100000:0.0:1789607826.565306:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:0.0:1789607826.565319:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:10418:x1876539520091776:12345-192.168.202.3@tcp:101:stat.0 00010000:00010000:0.0:1789607826.565355:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607826.565384:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386477 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9612 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.565515:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138647e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.565534:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138647e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.565549:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138647e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.565569:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386485 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.565578:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.565596:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.565994:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566004:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566156:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607826.566199:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789607826.566203:0:11489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607826.566225:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566236:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566243:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138647e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566248:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138647e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566253:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138647e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566258:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607826.566261:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138647e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566267:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138647e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566276:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:0.0:1789607826.566279:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607826.566283:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138647e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566294:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138647e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566305:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386485 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566308:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386485 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566312:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566316:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607826.566318:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386485 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566325:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386485 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566332:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1f911d400) 00010000:00010000:0.0:1789607826.566335:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607826.566337:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386485 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566343:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386485 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566384:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386477 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9612 expref: 24 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566405:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9612 expref: 23 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.566410:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:0.0:1789607826.566412:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607826.566414:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b000, rc 0) 00000100:00100000:0.0:1789607826.566550:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:10418:x1876539520091776:12345-192.168.202.3@tcp:101:stat.0 Request processed in 1232us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607826.566559:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:1.0:1789607826.575343:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607826.575378:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541096192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607826.575532:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607826.576194:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541096192 00000100:00100000:3.0:1789607826.576207:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541096192 00000100:00100000:3.0:1789607826.576320:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789607826.576333:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541096192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607826.576383:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607826.576512:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541096192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607826.576521:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789607826.576636:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541096192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607826.651782:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607826.651921:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520092032 00000100:00100000:2.0:1789607826.651934:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520092032 00000100:00100000:2.0:1789607826.652172:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 56 00000100:00100000:2.0:1789607826.652203:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:10428:x1876539520092032:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607826.652230:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607826.652257:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9619 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607826.652549:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789607826.652940:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386493 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9619 expref: 25 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.652956:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1db790800) 00010000:00010000:2.0:1789607826.652960:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607826.652966:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9619 expref: 25 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.653039:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3000, rc 0) 00000100:00100000:2.0:1789607826.653169:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:10428:x1876539520092032:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 969us (1400us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1789607826.653179:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 56 00000100:00100000:3.0:1789607826.657734:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607826.657971:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520092288 00000100:00100000:1.0:1789607826.658002:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520092288 00000100:00100000:1.0:1789607826.658082:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:1.0:1789607826.658096:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:10428:x1876539520092288:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1789607826.659103:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+25:10428:x1876539520092288:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 1002us (1377us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789607826.659115:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1789607826.729826:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607826.730030:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520092544 00000100:00100000:0.0:1789607826.730046:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520092544 00000100:00100000:0.0:1789607826.730139:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:0.0:1789607826.730151:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+25:10434:x1876539520092544:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1789607826.730184:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607826.730213:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013864a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9620 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.730360:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.730376:0:6790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9612 expref: 26 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.730385:0:6790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.730497:0:6790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9612 expref: 26 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.730514:0:6790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9612 expref: 26 pid: 11489 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607826.730529:0:6790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee725500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6790:1876539541096320:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607826.730664:0:6790:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ffa6da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789607826.739938:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607826.740299:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520092672 00000100:00100000:1.0:1789607826.740312:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520092672 00010000:00010000:1.0:1789607826.740455:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9612 expref: 27 pid: 11489 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607826.740571:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:1.0:1789607826.740584:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:2373:x1876539520092672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607826.740603:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607826.740612:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9612 expref: 27 pid: 11489 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.740647:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9612 expref: 27 pid: 11489 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.740676:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:1.0:1789607826.740683:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.740694:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.740702:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.740726:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607826.740804:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee725180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:2373:x1876539520092672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 222us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607826.740812:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 40 00010000:00010000:3.0:1789607826.742252:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138648c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9612 expref: 26 pid: 11489 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607826.742281:0:6790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee725500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6790:1876539541096320:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607826.742313:0:6790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.742324:0:6790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.742347:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607826.742373:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789607826.742708:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013864a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9620 expref: 27 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.742727:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9620 expref: 26 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.742738:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:3.0:1789607826.742741:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789607826.742744:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a200, rc 0) 00000100:00100000:3.0:1789607826.742812:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:10434:x1876539520092544:12345-192.168.202.3@tcp:101:bash.0 Request processed in 12662us (13003us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789607826.742822:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:0.0:1789607826.746352:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607826.746465:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520092928 00000100:00100000:2.0:1789607826.746480:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520092928 00000100:00100000:2.0:1789607826.746559:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:2.0:1789607826.746588:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:10434:x1876539520092928:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:2.0:1789607826.747288:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013864b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.747310:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013864b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.747339:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013864b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607826.747404:0:11489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1789607826.747467:0:11489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003a681af reply state 00000000580ccc60 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013864b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607826.747478:0:11489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607826.747616:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:10434:x1876539520092928:12345-192.168.202.3@tcp:36:bash.0 Request processed in 1045us (1279us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1789607826.747626:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 58 00000020:00080000:2.0:1789607826.747634:0:11489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789607826.749541:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013864b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.749562:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013864b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.749570:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013864b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.749577:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607826.749583:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013864b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.749592:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013864b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.749615:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:0.0:1789607826.749619:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607826.749694:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013864b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607826.749702:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013864b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607826.753548:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607826.754261:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520093056 00000100:00100000:2.0:1789607826.754279:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520093056 00000100:00100000:2.0:1789607826.754372:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:2.0:1789607826.754385:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:10434:x1876539520093056:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607826.754420:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607826.754478:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d0013864bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9627 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.754598:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013864c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.754616:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9620 expref: 29 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.754626:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013864c4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.754693:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9620 expref: 29 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.754709:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9620 expref: 29 pid: 6790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607826.754726:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541096448:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607826.754910:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607826.762118:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607826.762526:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541096448:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607826.762562:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013864c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607826.763057:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520093184 00000100:00100000:3.0:1789607826.763068:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520093184 00010000:00010000:3.0:1789607826.763242:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9620 expref: 30 pid: 6790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607826.763338:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:3.0:1789607826.763351:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:2374:x1876539520093184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607826.763370:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607826.763379:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9620 expref: 30 pid: 6790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.763412:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9620 expref: 30 pid: 6790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.763470:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013864a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9620 expref: 30 pid: 6790 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.763491:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:3.0:1789607826.763497:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013864c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.763508:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013864c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.763517:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013864c4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.763548:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607826.763628:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:2374:x1876539520093184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 281us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607826.763637:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 41 00010000:00010000:2.0:1789607826.764089:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013864c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.764109:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013864c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607826.764173:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789607826.764178:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607826.764204:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013864c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.764243:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d0013864bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9627 expref: 29 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.764263:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013864c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9627 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.764287:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:2.0:1789607826.764291:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607826.764294:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3600, rc 0) 00000100:00100000:2.0:1789607826.764352:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:10434:x1876539520093056:12345-192.168.202.3@tcp:101:bash.0 Request processed in 9968us (10819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607826.764360:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:1.0:1789607826.771473:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607826.771690:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520093440 00000100:00100000:2.0:1789607826.771704:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520093440 00000100:00100000:2.0:1789607826.771883:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:2.0:1789607826.771907:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1db76e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:10434:x1876539520093440:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:2.0:1789607826.772227:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1db76e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:10434:x1876539520093440:12345-192.168.202.3@tcp:35:bash.0 Request processed in 332us (815us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789607826.772236:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00010000:00010000:2.0:1789607826.829992:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607826.880728:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607826.880870:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520093696 00000100:00100000:3.0:1789607826.880884:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520093696 00000100:00100000:3.0:1789607826.880949:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:3.0:1789607826.880960:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:10444:x1876539520093696:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607826.881294:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607826.881317:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013864cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b962e expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607826.881929:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789607826.882364:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013864cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b962e expref: 31 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.882381:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1db790800) 00010000:00010000:3.0:1789607826.882384:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607826.882390:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013864cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b962e expref: 31 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.882405:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e000, rc 0) 00000100:00100000:3.0:1789607826.882582:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:10444:x1876539520093696:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1623us (1866us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789607826.882591:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:0.0:1789607826.885715:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607826.885832:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520093824 00000100:00100000:2.0:1789607826.885849:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520093824 00000100:00100000:2.0:1789607826.885948:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:2.0:1789607826.885959:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:10444:x1876539520093824:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:2.0:1789607826.886287:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d0013864d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.886308:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d0013864d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.886319:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d0013864d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.886351:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d0013864e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.886356:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d0013864e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.886360:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d0013864e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.886888:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013864e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.886911:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013864e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.886918:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013864e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607826.886967:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013864e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887723:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d0013864d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887733:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d0013864d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887739:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d0013864d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887743:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607826.887746:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d0013864d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887763:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d0013864d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887781:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:2.0:1789607826.887784:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607826.887791:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d0013864d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887797:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d0013864d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887814:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d0013864e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887820:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d0013864e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887826:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d0013864e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887830:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2e00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607826.887832:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d0013864e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887835:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d0013864e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887840:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1db790900) 00010000:00010000:2.0:1789607826.887842:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607826.887844:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d0013864e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887856:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d0013864e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887871:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013864e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887874:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013864e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887878:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013864e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887881:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2c00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607826.887883:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013864e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887886:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013864e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887890:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:2.0:1789607826.887891:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607826.887903:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013864e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.887906:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013864e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607826.889112:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:10444:x1876539520093824:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 3142us (3396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607826.889126:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:2.0:1789607826.893723:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607826.894011:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520094080 00000100:00100000:1.0:1789607826.894034:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520094080 00000100:00100000:1.0:1789607826.894119:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:1.0:1789607826.894219:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:10444:x1876539520094080:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1789607826.895183:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:10444:x1876539520094080:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 1041us (1471us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789607826.895194:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:2.0:1789607826.977519:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607826.977761:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520094336 00000100:00100000:1.0:1789607826.977785:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520094336 00000100:00100000:1.0:1789607826.978022:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:1.0:1789607826.978036:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:10447:x1876539520094336:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607826.978255:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607826.978283:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013864ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9635 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.978391:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013864f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.978411:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013864f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.978456:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013864f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.978478:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013864fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.978486:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013864fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.978493:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013864fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.979711:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386503 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.979733:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.979760:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386503 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607826.979786:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789607826.980050:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013864f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980061:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013864f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980068:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013864f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980075:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eec00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607826.980081:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013864f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980089:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013864f5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980105:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:1.0:1789607826.980109:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607826.980116:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013864f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980122:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013864f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980141:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013864fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980146:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013864fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980162:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013864fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980167:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607826.980170:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013864fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980176:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013864fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980184:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1dab7df00) 00010000:00010000:1.0:1789607826.980186:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607826.980189:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013864fc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980194:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013864fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980256:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013864ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9635 expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980272:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386503 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9635 expref: 33 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607826.980279:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:1.0:1789607826.980281:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607826.980285:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee200, rc 0) 00000100:00100000:1.0:1789607826.980392:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:10447:x1876539520094336:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2358us (2888us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1789607826.980412:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:0.0:1789607826.987542:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607826.987673:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520094464 00000100:00100000:3.0:1789607826.987687:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520094464 00000100:00100000:3.0:1789607826.987754:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:3.0:1789607826.987766:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:10447:x1876539520094464:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:3.0:1789607826.987866:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386511 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.987887:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.987909:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.987944:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386511 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.987970:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386511 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.987978:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.987986:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558e000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607826.987991:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386511 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.988000:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386511 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.988015:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:3.0:1789607826.988018:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607826.988025:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386511 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607826.988032:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386511 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607826.988123:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:10447:x1876539520094464:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 360us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607826.988132:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:2.0:1789607826.990699:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607826.990949:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520094720 00000100:00100000:0.0:1789607826.990962:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520094720 00000100:00100000:0.0:1789607826.991039:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:0.0:1789607826.991051:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:10447:x1876539520094720:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1789607826.991354:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:10447:x1876539520094720:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 304us (670us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789607826.991363:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:1.0:1789607826.997869:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607826.998152:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520094848 00000100:00100000:2.0:1789607826.998165:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520094848 00000100:00100000:2.0:1789607826.998246:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:2.0:1789607826.998258:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:2374:x1876539520094848:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607826.998276:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607826.998306:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386503 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9635 expref: 34 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607826.998333:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:2.0:1789607826.998340:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607826.998465:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:2374:x1876539520094848:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 167us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607826.998474:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:2.0:1789607827.082023:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607827.082856:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520095104 00000100:00100000:0.0:1789607827.082872:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520095104 00000100:00100000:0.0:1789607827.083013:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 64 00000100:00100000:0.0:1789607827.083026:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:10465:x1876539520095104:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1789607827.083058:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607827.083085:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386518 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b963c expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.083220:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138651f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.083239:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138651f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.083271:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138651f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607827.083285:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789607827.083487:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386518 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b963c expref: 36 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.083511:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138651f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b963c expref: 35 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.083518:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:0.0:1789607827.083522:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789607827.083525:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b000, rc 0) 00000100:00100000:0.0:1789607827.083678:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:10465:x1876539520095104:12345-192.168.202.3@tcp:101:cat.0 Request processed in 655us (1672us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1789607827.083686:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 64 00000100:00100000:3.0:1789607827.108798:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607827.109096:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520095232 00000100:00100000:1.0:1789607827.109111:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520095232 00000100:00100000:1.0:1789607827.109233:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 65 00000100:00100000:1.0:1789607827.109249:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:10466:x1876539520095232:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607827.109283:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607827.109311:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d00138652d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9643 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607827.109393:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386534 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607827.109410:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607827.109460:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607827.109515:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789607827.109519:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607827.109539:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607827.109569:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d00138652d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9643 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607827.109603:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9643 expref: 36 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607827.109634:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:1.0:1789607827.109638:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607827.109642:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4eec00, rc 0) 00000100:00100000:1.0:1789607827.109719:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:10466:x1876539520095232:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 474us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607827.109726:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 65 00000100:00100000:1.0:1789607827.115211:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607827.115660:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520095616 00000100:00100000:0.0:1789607827.115679:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520095616 00000100:00100000:0.0:1789607827.115803:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:0.0:1789607827.115818:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:10466:x1876539520095616:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1789607827.116917:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:10466:x1876539520095616:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 1094us (1716us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789607827.116929:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:3.0:1789607827.120291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607827.120378:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520095744 00000100:00100000:0.0:1789607827.120391:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520095744 00000100:00100000:0.0:1789607827.120512:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:0.0:1789607827.120525:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:10466:x1876539520095744:12345-192.168.202.3@tcp:103:lfs.0 00010000:00010000:0.0:1789607827.120565:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789607827.120610:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013864c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9627 expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.120639:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138651f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b963c expref: 36 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.120652:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013863c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95e8 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.120662:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:0.0:1789607827.120678:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607827.121209:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:10466:x1876539520095744:12345-192.168.202.3@tcp:103:lfs.0 Request processed in 684us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607827.121218:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:3.0:1789607827.123640:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607827.123735:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520095872 00000100:00100000:0.0:1789607827.123748:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520095872 00000100:00100000:0.0:1789607827.123809:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:0.0:1789607827.123821:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:10466:x1876539520095872:12345-192.168.202.3@tcp:58:lfs.0 00010000:00010000:0.0:1789607827.124136:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138653b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.124156:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138653b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.124170:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138653b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607827.126684:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607827.127198:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1789607827.127282:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1789607827.127987:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:10466:x1876539520095872:12345-192.168.202.3@tcp:58:lfs.0 Request processed in 4157us (4488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607827.128002:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:2.0:1789607827.153860:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607827.154207:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520096000 00000100:00100000:0.0:1789607827.154222:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520096000 00000100:00100000:0.0:1789607827.154305:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 67 00000100:00100000:0.0:1789607827.154318:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:10468:x1876539520096000:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607827.154346:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607827.154375:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386542 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b964a expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.154521:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386549 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.154539:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386549 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.154554:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386549 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.154580:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386550 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.154588:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.154617:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.155785:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.155804:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.155816:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607827.155881:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789607827.155887:0:11489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607827.155922:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.155938:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.155949:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386549 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.155956:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386549 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.155964:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386549 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.155972:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607827.156220:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386549 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156243:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386549 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156260:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:0.0:1789607827.156263:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607827.156270:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386549 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156277:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386549 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156292:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386550 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156298:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386550 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156305:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156311:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607827.156314:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386550 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156320:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386550 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156327:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1f911d300) 00010000:00010000:0.0:1789607827.156330:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607827.156333:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386550 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156348:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386550 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156400:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386542 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b964a expref: 36 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156416:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b964a expref: 35 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607827.156482:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d400) 00010000:00010000:0.0:1789607827.156485:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607827.156487:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a200, rc 0) 00000100:00100000:0.0:1789607827.156781:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:10468:x1876539520096000:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2462us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607827.156791:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 67 00010000:00010000:1.0:1789607827.853652:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789607828.111232:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789607828.111242:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789607828.111315:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789607828.111324:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789607828.111509:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee724e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1876539541096704:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789607828.111629:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ffa6d840 going to sleep for 11 seconds 00000100:00100000:0.0:1789607828.111648:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607828.111660:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541096576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607828.111718:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607828.111899:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541096576 00000100:00100000:0.0:1789607828.111908:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541096576 00000100:00100000:0.0:1789607828.111977:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789607828.111998:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876539541096576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607828.112044:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607828.112097:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1876539541096576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607828.112104:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789607828.112164:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541096576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789607828.112384:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607828.120699:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee724e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1876539541096704:192.168.202.3@tcp:107:hsm_cdtr.0 00000040:00080000:2.0:1789607828.124032:0:12015:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789607828.124047:0:12015:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789607828.124106:0:12015:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789607828.124113:0:12015:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789607828.129794:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607828.129939:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520096128 00000100:00100000:2.0:1789607828.129955:0:5859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520096128 00000100:00100000:2.0:1789607828.130051:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:2.0:1789607828.130078:0:5859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:10479:x1876539520096128:12345-192.168.202.3@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789607828.130188:0:5859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:10479:x1876539520096128:12345-192.168.202.3@tcp:900:lhsmtool_posix.0 Request processed in 125us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607828.130206:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00080000:0.0:1789607828.130728:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607828.139138:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607828.139265:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520096256 00000100:00100000:0.0:1789607828.139278:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520096256 00000100:00100000:0.0:1789607828.139356:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:0.0:1789607828.139368:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:10479:x1876539520096256:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789607828.139497:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789607828.139636:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:10479:x1876539520096256:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 268us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607828.139643:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:0.0:1789607828.148465:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607828.149869:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520096384 00000100:00100000:1.0:1789607828.149897:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520096384 00000100:00100000:1.0:1789607828.150065:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:1.0:1789607828.150078:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:10479:x1876539520096384:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789607828.150176:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d00138655e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150197:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d00138655e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150213:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d00138655e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150232:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d001386565 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150239:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d001386565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150246:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d001386565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150291:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138656c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150301:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138656c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150308:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138656c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607828.150361:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789607828.150366:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607828.150381:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138656c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150393:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d00138655e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150401:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d00138655e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150446:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d00138655e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150454:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607828.150459:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d00138655e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150468:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d00138655e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150484:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1f911d000) 00010000:00010000:1.0:1789607828.150732:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607828.150742:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d00138655e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150749:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d00138655e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150767:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d001386565 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150774:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d001386565 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150781:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d001386565 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150787:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efa00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607828.150790:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d001386565 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150795:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d001386565 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150803:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff99a1dab7df00) 00010000:00010000:1.0:1789607828.150806:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607828.150809:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d001386565 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150815:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d001386565 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150893:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138656c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150907:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138656c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150913:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138656c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150919:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607828.150922:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138656c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150929:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138656c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150938:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d400) 00010000:00010000:1.0:1789607828.150941:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607828.150944:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138656c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.150951:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138656c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607828.151063:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:10479:x1876539520096384:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 Request processed in 985us (2608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607828.151072:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:2.0:1789607828.155870:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607828.155974:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520096640 00000100:00100000:3.0:1789607828.155988:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520096640 00000100:00100000:3.0:1789607828.156082:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 70 00000100:00100000:3.0:1789607828.156095:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:10479:x1876539520096640:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607828.156239:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607828.156267:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386573 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9651 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.156406:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138657a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.156447:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138657a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.156463:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138657a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607828.156477:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789607828.156685:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138657a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.156694:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138657a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.156702:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138657a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.156709:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558e800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607828.156714:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138657a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.156742:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138657a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.156759:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d400) 00010000:00010000:3.0:1789607828.156762:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607828.156769:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138657a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.156776:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138657a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.156837:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386573 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9651 expref: 37 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.156847:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1f911d000) 00010000:00010000:3.0:1789607828.156850:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607828.156854:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386573 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9651 expref: 37 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.156864:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e000, rc 0) 00000100:00100000:3.0:1789607828.157024:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:10479:x1876539520096640:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 931us (1168us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1789607828.157034:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 70 00000100:00100000:0.0:1789607828.175477:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607828.175714:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520096768 00000100:00100000:1.0:1789607828.175730:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520096768 00000100:00100000:1.0:1789607828.175812:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 71 00000100:00100000:1.0:1789607828.175824:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:10479:x1876539520096768:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789607828.175878:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789607828.176067:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:10479:x1876539520096768:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 244us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607828.176076:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 71 00000100:00100000:0.0:1789607828.182341:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607828.182988:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520097024 00000100:00100000:3.0:1789607828.183003:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520097024 00000100:00100000:3.0:1789607828.183229:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 72 00000100:00100000:3.0:1789607828.183244:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:10479:x1876539520097024:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607828.183293:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607828.183298:0:6790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789607828.183336:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386534 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9643 expref: 36 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.183361:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:3.0:1789607828.183367:0:6790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607828.183386:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386588 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9658 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789607828.188291:0:6790:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789607828.189242:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138658f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.189268:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138658f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.189284:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138658f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.189373:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386588 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9658 expref: 38 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.189396:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138658f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9658 expref: 37 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.189406:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1c3982d00) 00010000:00010000:3.0:1789607828.189410:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607828.189452:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e800, rc 0) 00000100:00100000:3.0:1789607828.189553:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:10479:x1876539520097024:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 6312us (7223us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789607828.189564:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 72 00000100:00100000:1.0:1789607828.196797:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607828.196848:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520097280 00000100:00100000:1.0:1789607828.196861:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520097280 00000100:00100000:1.0:1789607828.198055:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00100000:1.0:1789607828.198073:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:10479:x1876539520097280:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607828.198231:0:11489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607828.198271:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138658f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9658 expref: 37 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198294:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1c3982d00) 00010000:00010000:1.0:1789607828.198309:0:11489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607828.198338:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138659d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198356:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138659d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198368:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138659d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198594:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x80957a70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198619:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x80957a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198632:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x80957a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198868:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138659d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198877:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138659d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198896:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138659d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198904:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607828.198909:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138659d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198917:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138659d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198931:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:1.0:1789607828.198934:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607828.198940:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138659d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198946:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138659d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198962:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x80957a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198968:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x80957a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198973:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x80957a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198986:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efa00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607828.198990:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x80957a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.198997:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x80957a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.199007:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x80957a70 (ffff99a1dab7df00) 00010000:00010000:1.0:1789607828.199010:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607828.199013:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x80957a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.199019:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x80957a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607828.199805:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:10479:x1876539520097280:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 1727us (3012us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789607828.199816:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00100000:2.0:1789607828.204605:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607828.205042:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520097408 00000100:00100000:3.0:1789607828.205057:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520097408 00000100:00100000:3.0:1789607828.205206:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:3.0:1789607828.205223:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:10479:x1876539520097408:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607828.205255:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607828.205290:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013865ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b965f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.205341:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.205359:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.205374:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.205620:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013865ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b965f expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.205646:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b965f expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.205655:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1c3982a00) 00010000:00010000:2.0:1789607828.205659:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789607828.205664:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f000, rc 0) 00000100:00100000:2.0:1789607828.205749:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:10479:x1876539520097408:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 530us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607828.205757:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:0.0:1789607828.209356:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607828.212741:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520097664 00000100:00100000:3.0:1789607828.212759:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520097664 00000100:00100000:3.0:1789607828.212849:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:3.0:1789607828.212862:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:10479:x1876539520097664:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789607828.212997:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013865b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.213018:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013865b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.213052:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013865b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607828.213486:0:6790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1789607828.213498:0:6790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362058074560ns, next at 363058071717ns, rc = 0 00000004:00010000:3.0:1789607828.213616:0:6790:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c08edd4 reply state 00000000a4e17094 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013865b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607828.213628:0:6790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607828.213768:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+39:10479:x1876539520097664:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 906us (4424us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789607828.213777:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:1.0:1789607828.219654:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607828.219719:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520097792 00000100:00100000:1.0:1789607828.219730:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520097792 00000100:00100000:1.0:1789607828.219793:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 76 00010000:00010000:3.0:1789607828.219799:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013865b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607828.219807:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+39:10479:x1876539520097792:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607828.219830:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013865b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.219841:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013865b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.219842:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607828.219853:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fe00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607828.219860:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013865b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.219869:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9666 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.219872:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013865b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.219957:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9666 expref: 40 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.219991:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9666 expref: 40 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.220012:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1c3982a00) 00010000:00010000:1.0:1789607828.220015:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789607828.220019:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4efa00, rc 0) 00000100:00100000:1.0:1789607828.220080:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+40:10479:x1876539520097792:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 274us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607828.220087:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 76 00010000:00010000:3.0:1789607828.221064:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1c3982a00) 00010000:00010000:3.0:1789607828.221069:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789607828.221084:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013865b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.221093:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013865b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607828.222513:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607828.222554:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520097920 00000100:00100000:3.0:1789607828.222566:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520097920 00000100:00100000:3.0:1789607828.222823:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:3.0:1789607828.222835:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2372:x1876539520097920:12345-192.168.202.3@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789607828.222879:0:8471:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp t0 exp 0000000000000000 cur 362 last 0 00000020:00000080:3.0:1789607828.222993:0:8471:0:(genops.c:1384:class_connect()) connect: client d0d9aceb-01dc-4deb-add2-cd492a0443a6, cookie 0x33f091d0013865c7 00002000:00100000:3.0:1789607828.223008:0:8471:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d0d9aceb-01dc-4deb-add2-cd492a0443a6/ffff99a1ee950000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789607828.223038:0:8471:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789607828.223517:0:8471:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789607828.223558:0:8471:0:(import.c:65:import_set_state_nolock()) ffff99a1ee956000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607828.223801:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2372:x1876539520097920:12345-192.168.202.3@tcp:8:lhsmtool_posix.0 Request processed in 965us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607828.223809:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:0.0:1789607828.231865:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607828.232044:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520098048 00000100:00100000:3.0:1789607828.232057:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520098048 00000100:00100000:3.0:1789607828.234015:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:3.0:1789607828.234038:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:0:x1876539520098048:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789607828.247458:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789607828.314707:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1789607828.314728:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000100:00100000:3.0:1789607828.314939:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:0:x1876539520098048:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 80904us (83079us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789607828.314950:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:1.0:1789607828.321043:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607828.321116:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520098304 00000100:00100000:3.0:1789607828.321127:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520098304 00000100:00100000:3.0:1789607828.321185:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:3.0:1789607828.321195:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+39:10479:x1876539520098304:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789607828.321508:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+40:10479:x1876539520098304:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 313us (471us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789607828.321516:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:0.0:1789607828.327409:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607828.327473:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520098560 00000100:00100000:2.0:1789607828.327483:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520098560 00000100:00100000:2.0:1789607828.327536:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:2.0:1789607828.327845:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+40:10479:x1876539520098560:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789607828.327963:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+40:10479:x1876539520098560:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 418us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607828.327970:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:1.0:1789607828.333507:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607828.333615:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520098688 00000100:00100000:0.0:1789607828.333625:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520098688 00000100:00100000:0.0:1789607828.333683:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:0.0:1789607828.333694:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+40:10479:x1876539520098688:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607828.333734:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607828.333755:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b966d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.333829:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013865d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.333843:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013865d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.333854:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013865d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607828.333899:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607828.333928:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013865d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.333954:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b966d expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.333969:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013865d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b966d expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.333978:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1c3982a00) 00010000:00010000:0.0:1789607828.333981:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789607828.333985:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a400, rc 0) 00000100:00100000:0.0:1789607828.334061:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+41:10479:x1876539520098688:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 369us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607828.334068:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:1.0:1789607828.340848:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607828.341074:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520098816 00000100:00100000:2.0:1789607828.341085:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520098816 00000100:00100000:2.0:1789607828.341144:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:2.0:1789607828.341172:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2373:x1876539520098816:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607828.341190:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607828.341216:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006d204a4/0x33f091d0013865dc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9674 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789607828.341243:0:8471:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab3f94, blocks: 0x1 00010000:00010000:2.0:1789607828.341263:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1789607828.341267:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607828.341276:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006d204a4/0x33f091d0013865dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9674 expref: 6 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.341298:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006d204a4/0x33f091d0013865dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9674 expref: 6 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.341312:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3800, rc 0) 00000100:00100000:2.0:1789607828.341380:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520098816:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 210us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607828.341387:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:0.0:1789607828.347489:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607828.347526:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520099072 00000100:00100000:0.0:1789607828.347536:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520099072 00000100:00100000:0.0:1789607828.349786:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:0.0:1789607828.349810:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+41:10479:x1876539520099072:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789607828.349940:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+41:10479:x1876539520099072:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 139us (2460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607828.349948:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:2.0:1789607828.362623:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607828.362770:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520099200 00000100:00100000:1.0:1789607828.362782:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520099200 00000100:00100000:1.0:1789607828.362841:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:1.0:1789607828.362850:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:10479:x1876539520099200:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607828.362867:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607828.362898:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b967b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.362938:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000006d204a4/0x33f091d0013865dc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9674 expref: 7 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.362960:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607828.362964:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607828.362969:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b967b expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.363004:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000006d204a4/0x33f091d0013865dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9674 expref: 7 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.363016:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000006d204a4/0x33f091d0013865dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9674 expref: 7 pid: 8471 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607828.363031:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff418e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876539541096832:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607828.363127:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff4bf000 going to sleep for 11 seconds 00000100:00100000:1.0:1789607828.366469:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff418e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876539541096832:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607828.366512:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b967b expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.366537:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee000, rc 0) 00000100:00100000:1.0:1789607828.366661:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:10479:x1876539520099200:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 3811us (4047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607828.366671:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:2.0:1789607828.368933:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607828.369286:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520099328 00000100:00100000:1.0:1789607828.369298:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520099328 00010000:00010000:1.0:1789607828.369352:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000006d204a4/0x33f091d0013865dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9674 expref: 7 pid: 8471 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607828.369464:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:1.0:1789607828.369475:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520099328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607828.369490:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607828.369515:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000006d204a4/0x33f091d0013865dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9674 expref: 7 pid: 8471 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.369531:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000006d204a4/0x33f091d0013865dc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9674 expref: 7 pid: 8471 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.369556:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006d204a4/0x33f091d0013865dc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9674 expref: 7 pid: 8471 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.369582:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607828.369594:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607828.369603:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b967b expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.369612:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b967b expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.369647:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b967b expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607828.369661:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff418e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5834:1876539541096960:192.168.202.3@tcp:105: 00000100:00100000:1.0:1789607828.371108:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff4bf000 going to sleep for 11 seconds 00000100:00100000:1.0:1789607828.374498:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff418e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5834:1876539541096960:192.168.202.3@tcp:105: 00010000:00010000:1.0:1789607828.374527:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607828.374583:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2374:x1876539520099328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5108us (5660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607828.374732:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:1.0:1789607828.378736:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607828.379020:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520099456 00000100:00100000:3.0:1789607828.379031:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520099456 00002000:00100000:3.0:1789607828.379081:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99a1ff419c00 x1876539520099456/t0(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:384/0 lens 504/0 e 0 to 0 dl 1789607839 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789607828.379092:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1ff419c00 with x1876539520099456 ext(0->8) 00002000:00010000:3.0:1789607828.379098:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1ff419c00 00000100:00100000:3.0:1789607828.379177:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:3.0:1789607828.379187:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2374:x1876539520099456:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789607828.379838:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520099456:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 Request processed in 651us (1112us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789607828.379844:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00002000:00100000:3.0:1789607828.379850:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99a1ff419c00 x1876539520099456/t4294967302(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:384/0 lens 504/448 e 0 to 0 dl 1789607839 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789607828.379856:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1ff419c00 with x1876539520099456 ext(0->8) 00002000:00010000:3.0:1789607828.379859:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1ff419c00 00000100:00100000:2.0:1789607828.382747:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607828.382891:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520099584 00000100:00100000:1.0:1789607828.382901:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520099584 00000100:00100000:1.0:1789607828.382970:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:1.0:1789607828.383100:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+41:10479:x1876539520099584:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789607828.418839:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000020:00080000:2.0:1789607828.418899:0:5869:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1789607828.418917:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1789607828.418925:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789607828.418947:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1789607828.418956:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789607828.419143:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607828.419165:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541097088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789607828.419233:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607828.419455:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:10479:x1876539520099584:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 Request processed in 36357us (36715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607828.419484:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:0.0:1789607828.422264:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607828.422556:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541097088 00000100:00100000:1.0:1789607828.422577:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541097088 00000100:00080000:0.0:1789607828.422732:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607828.422842:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520099712 00000100:00100000:3.0:1789607828.422847:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520099712 00000100:00100000:3.0:1789607828.422896:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607828.422906:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541097088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789607828.423099:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789607828.423103:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789607828 00002000:00010000:3.0:1789607828.423106:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789607828.423108:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789607828 -> 1789607828 00002000:00010000:3.0:1789607828.423110:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789607828.423184:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201656d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1876539541097088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 278us (3949us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789607828.423191:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607828.423213:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:3.0:1789607828.423220:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520099712:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1789607828.423529:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a1ff41aa00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789607828.423537:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541097088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789607828.464275:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201655f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520099712:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 Request processed in 41039us (42004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607828.464292:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 30 00000001:00080000:0.0:1789607828.465901:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789607828.465917:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1789607828.467995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607828.468314:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520099968 00000100:00100000:1.0:1789607828.468324:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520099968 00000100:00100000:1.0:1789607828.468381:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:1.0:1789607828.468392:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:10479:x1876539520099968:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607828.468482:0:11489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607828.468510:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013865d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b966d expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.468529:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1c3982a00) 00010000:00010000:1.0:1789607828.468534:0:11489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607828.468578:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013865ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.468736:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013865ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.468756:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013865ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607828.469156:0:11489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cd8e37a4 reply state 0000000050cbc8d3 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013865ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607828.469165:0:11489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607828.469572:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:10479:x1876539520099968:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 1171us (1586us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789607828.469581:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 81 00010000:00010000:0.0:1789607828.474129:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013865ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.474147:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013865ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.474155:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013865ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.474162:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607828.474166:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013865ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.474190:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013865ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.474210:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1c3982a00) 00010000:00010000:0.0:1789607828.474213:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607828.474218:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013865ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.474225:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013865ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607828.474930:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607828.475076:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520100096 00000100:00100000:3.0:1789607828.475086:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520100096 00000100:00100000:3.0:1789607828.475142:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:3.0:1789607828.475152:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2374:x1876539520100096:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789607828.475405:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789607828.475409:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789607828 -> 1789607826 00002000:00010000:3.0:1789607828.475412:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789607825 00002000:00010000:3.0:1789607828.475454:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789607828 -> 1789607826 00002000:00010000:3.0:1789607828.475456:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789607828.475513:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5273480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520100096:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 363us (587us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789607828.475521:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:2.0:1789607828.480185:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607828.480278:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520100352 00000100:00100000:0.0:1789607828.480289:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520100352 00000100:00100000:0.0:1789607828.480366:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:0.0:1789607828.480377:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:10479:x1876539520100352:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789607828.480502:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.480524:0:6790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b965f expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.480535:0:6790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.480587:0:6790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b965f expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.480720:0:6790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b965f expref: 13 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607828.480905:0:6790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c5272300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6790:1876539541097216:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607828.481268:0:6790:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ffa6d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789607828.487052:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607828.487167:0:6790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c5272300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6790:1876539541097216:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607828.487194:0:6790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607828.487260:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520100480 00000100:00100000:3.0:1789607828.487268:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520100480 00010000:00010000:3.0:1789607828.487303:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b965f expref: 14 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607828.487342:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:3.0:1789607828.487350:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5273100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:2374:x1876539520100480:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607828.487365:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607828.487372:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b965f expref: 14 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.487383:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b965f expref: 14 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.487403:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b965f expref: 14 pid: 5848 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.487419:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1c3982a00) 00010000:00010000:3.0:1789607828.487467:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.487477:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.487501:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.487532:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607828.487581:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5273100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:2374:x1876539520100480:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 231us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607828.487596:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 43 00010000:00010000:2.0:1789607828.487890:0:6790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.487899:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.487926:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.487933:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.487940:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.487946:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103bc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607828.487951:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.487958:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.487966:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1c3982a00) 00010000:00010000:2.0:1789607828.487969:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789607828.487972:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.487978:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d0013865f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607828.488059:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+12:10479:x1876539520100352:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 Request processed in 7684us (7884us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789607828.488074:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:0.0:1789607828.492297:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607828.492393:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520100608 00000100:00100000:1.0:1789607828.492406:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520100608 00000100:00100000:1.0:1789607828.492502:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:1.0:1789607828.492512:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2373:x1876539520100608:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789607828.492562:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.492584:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b967b expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.492592:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607828.492597:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789607828.492614:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.492653:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b967b expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.492668:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b967b expref: 7 pid: 6692 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607828.492682:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff418e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876539541097344:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607828.493293:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff4bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607828.504249:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607828.504467:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520100736 00000100:00100000:2.0:1789607828.504477:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520100736 00010000:00010000:2.0:1789607828.504516:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b967b expref: 8 pid: 6692 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607828.504559:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:2.0:1789607828.504570:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5271f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2373:x1876539520100736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607828.504585:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607828.504607:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b967b expref: 8 pid: 6692 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.504620:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b967b expref: 8 pid: 6692 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.504647:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607828.504652:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607828.504658:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.504668:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.504688:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607828.504736:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5271f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2373:x1876539520100736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 169us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607828.504760:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 44 00010000:00010000:1.0:1789607828.505056:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000163ddcc7/0x33f091d0013865e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b967b expref: 7 pid: 6692 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607828.505076:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff418e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876539541097344:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607828.505101:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.505111:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.505119:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.505151:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.505176:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.505185:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.505192:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607828.505196:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.505207:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.505222:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.505230:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d3364c/0x33f091d0013865f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607828.505304:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5270e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520100608:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 Request processed in 12793us (13019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607828.505313:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:0.0:1789607828.518985:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607828.519100:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520100992 00000100:00100000:3.0:1789607828.519110:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520100992 00000100:00100000:3.0:1789607828.519269:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 83 00000100:00100000:3.0:1789607828.519282:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+12:10479:x1876539520100992:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789607828.519376:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.519395:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.519409:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.522028:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.522056:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9666 expref: 13 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.522065:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.522104:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9666 expref: 13 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.522134:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9666 expref: 13 pid: 11489 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607828.522150:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d99880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541097472:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607828.522240:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db3600 going to sleep for 11 seconds 00000100:00100000:3.0:1789607828.525165:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d99880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541097472:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607828.525196:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607828.526826:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607828.526921:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520101120 00000100:00100000:3.0:1789607828.526931:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520101120 00010000:00010000:3.0:1789607828.526973:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9666 expref: 14 pid: 11489 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607828.527018:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:3.0:1789607828.527028:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5271880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:2373:x1876539520101120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607828.527043:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607828.527050:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9666 expref: 14 pid: 11489 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.527063:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9666 expref: 14 pid: 11489 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.527087:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013865c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9666 expref: 14 pid: 11489 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.527127:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1c3982a00) 00010000:00010000:3.0:1789607828.527133:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.527143:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.527150:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.527186:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607828.527245:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5271880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:2373:x1876539520101120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 218us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607828.527252:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00010000:00010000:1.0:1789607828.528703:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607828.528733:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789607828.528961:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1789607828.529130:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1789607828.529195:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1789607828.529292:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff418e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5848:1876539541097600:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789607828.529376:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607828.529831:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff4bf540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607828.529933:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541097600 00000100:00100000:2.0:1789607828.529941:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541097600 00000100:00100000:2.0:1789607828.529997:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607828.530007:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876539541097600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789607828.530082:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876539541097600:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607828.530089:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607828.530229:0:5848:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789607828.530235:0:5848:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a1ff41aa00, transno 4294967303 00000100:00100000:0.0:1789607828.530254:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff418e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5848:1876539541097600:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789607828.530786:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1789607828.530855:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c5270a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5848:1876539541097728:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789607828.530903:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607828.530931:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ffa6d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607828.531111:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541097728 00000100:00100000:2.0:1789607828.531117:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541097728 00000100:00100000:2.0:1789607828.531161:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607828.531169:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1876539541097728:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789607828.531350:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1876539541097728:12345-0@lo:1000:mdt00_001.0 Request processed in 181us (446us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789607828.531357:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607828.531523:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c5270a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5848:1876539541097728:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789607828.531555:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531577:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531585:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531591:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fe00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607828.531596:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531617:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531632:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1c3982a00) 00010000:00010000:0.0:1789607828.531635:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607828.531641:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531648:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386606 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531682:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138653b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531689:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138653b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531695:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138653b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531700:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607828.531703:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138653b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531709:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138653b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531716:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d400) 00010000:00010000:0.0:1789607828.531718:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607828.531721:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138653b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531737:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138653b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531758:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531771:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b964a expref: 16 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531781:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531805:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b964a expref: 16 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.531819:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b964a expref: 16 pid: 11489 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607828.531830:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c5270000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541097856:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607828.531903:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ffa6d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607828.537774:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607828.537853:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520101248 00000100:00100000:2.0:1789607828.537864:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520101248 00010000:00010000:2.0:1789607828.537912:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b964a expref: 17 pid: 11489 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607828.537951:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:2.0:1789607828.537961:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5271c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+17:2374:x1876539520101248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607828.537984:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607828.537992:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b964a expref: 17 pid: 11489 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.538024:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b964a expref: 17 pid: 11489 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.538047:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d400) 00010000:00010000:2.0:1789607828.538053:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.538064:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.538071:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.538090:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607828.538180:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5271c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+17:2374:x1876539520101248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 220us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607828.538187:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 46 00010000:00010000:3.0:1789607828.538478:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386557 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b964a expref: 16 pid: 11489 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607828.538496:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c5270000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541097856:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607828.538516:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538525:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538530:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538541:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538566:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538573:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538580:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607828.538585:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538593:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538602:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d400) 00010000:00010000:3.0:1789607828.538605:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607828.538609:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538614:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138660d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538625:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538631:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538637:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538641:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607828.538651:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538657:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538666:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911d400) 00010000:00010000:3.0:1789607828.538668:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789607828.538671:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607828.538676:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013865ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607828.538941:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5272680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:10479:x1876539520100992:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 19661us (19964us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1789607828.538950:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 83 00000020:00080000:3.0:1789607828.538954:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789607828.542170:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789607828.542180:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789607828.542213:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789607828.542221:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789607828.542384:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607828.542656:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520101504 00000100:00100000:0.0:1789607828.542664:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520101504 00000100:00100000:0.0:1789607828.542715:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:0.0:1789607828.542740:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:10479:x1876539520101504:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789607828.544670:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789607828.544780:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1789607828.544920:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386614 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.544937:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.544949:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386614 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.544959:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386614 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.544965:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386614 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.544972:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607828.545192:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789607828.545308:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+17:10479:x1876539520101504:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 2565us (2923us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789607828.545317:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000020:00080000:0.0:1789607828.545323:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789607828.548227:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607828.548241:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386614 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.548251:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a000 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607828.548255:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386614 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.548264:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386614 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.548302:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:2.0:1789607828.548305:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789607828.548310:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386614 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.548317:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d001386614 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607828.548340:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607828.548343:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607828.548344:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607828.877251:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607829.900572:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607830.014076:0:12067:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789607830.014085:0:12067:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789607830.014120:0:12067:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789607830.014126:0:12067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789607830.205047:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607830.205161:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520101760 00000100:00100000:3.0:1789607830.205172:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520101760 00000100:00100000:3.0:1789607830.205238:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:3.0:1789607830.205249:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+17:10497:x1876539520101760:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607830.205276:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607830.205296:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138661b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9682 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.205944:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f400/0x33f091d001386622 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.205962:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f400/0x33f091d001386622 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.205982:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f400/0x33f091d001386622 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607830.205995:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789607830.206106:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138661b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9682 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.206121:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f400/0x33f091d001386622 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9682 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.206129:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:3.0:1789607830.206132:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789607830.206135:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f400, rc 0) 00000100:00100000:3.0:1789607830.206197:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:10497:x1876539520101760:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 950us (1159us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789607830.206204:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00080000:0.0:1789607830.206293:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607830.211960:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.212010:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520101888 00000100:00100000:0.0:1789607830.212020:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520101888 00000100:00100000:0.0:1789607830.212076:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:0.0:1789607830.212086:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:10497:x1876539520101888:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:0.0:1789607830.212170:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386630 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212187:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386630 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212199:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386630 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212216:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386637 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212224:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386637 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212230:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386637 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212518:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138663e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212527:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138663e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212534:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138663e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607830.212708:0:6790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138663e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212729:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386630 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212736:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386630 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212743:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386630 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212749:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607830.212753:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386630 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212760:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386630 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212772:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:0.0:1789607830.212776:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607830.212781:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386630 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212787:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d001386630 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212799:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386637 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212888:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386637 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212895:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386637 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212906:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607830.212910:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386637 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212916:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386637 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212925:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1f911da00) 00010000:00010000:0.0:1789607830.212927:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607830.212931:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386637 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212937:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386637 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212953:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138663e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212960:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138663e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212965:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138663e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212971:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607830.212974:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138663e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.212980:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138663e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.213000:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1f911db00) 00010000:00010000:0.0:1789607830.213002:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607830.213006:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138663e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.213012:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138663e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607830.213098:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:10497:x1876539520101888:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 1011us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607830.213108:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:2.0:1789607830.253936:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607830.257722:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520102144 00000100:00100000:3.0:1789607830.257740:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520102144 00000100:00100000:2.0:1789607830.261937:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:2.0:1789607830.261960:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:10500:x1876539520102144:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607830.261987:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607830.262010:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386645 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9689 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262101:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138664c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262241:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138664c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262253:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138664c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262288:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386653 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262296:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262303:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262759:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d00138665a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262769:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d00138665a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262777:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d00138665a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607830.262789:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789607830.262893:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138664c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262901:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138664c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262908:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138664c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262914:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607830.262919:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138664c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262936:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138664c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262948:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:2.0:1789607830.262951:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607830.262956:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138664c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262961:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138664c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262971:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386653 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262976:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386653 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262981:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262987:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607830.262989:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386653 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.262994:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386653 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.263000:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1db790700) 00010000:00010000:2.0:1789607830.263003:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607830.263005:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386653 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.263020:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386653 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.263075:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386645 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9689 expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.263089:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d00138665a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9689 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.263096:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790600) 00010000:00010000:2.0:1789607830.263099:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607830.263101:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e2600, rc 0) 00000100:00100000:2.0:1789607830.263169:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:10500:x1876539520102144:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1216us (9241us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789607830.263177:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:0.0:1789607830.269276:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607830.269653:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520102272 00000100:00100000:3.0:1789607830.269664:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520102272 00000100:00100000:3.0:1789607830.269728:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 87 00000100:00100000:3.0:1789607830.269738:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:10500:x1876539520102272:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:3.0:1789607830.269800:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386668 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.270088:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.270116:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.270145:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386668 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.270152:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386668 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.270159:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.270165:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607830.270170:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386668 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.270176:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386668 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.270188:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790600) 00010000:00010000:3.0:1789607830.270191:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607830.270196:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386668 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.270202:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386668 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607830.270324:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:10500:x1876539520102272:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 586us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607830.270332:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 87 00000100:00100000:3.0:1789607830.277798:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.278031:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520102528 00000100:00100000:0.0:1789607830.278042:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520102528 00000100:00100000:0.0:1789607830.278118:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:0.0:1789607830.278128:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1db76d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:10500:x1876539520102528:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1789607830.278385:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1db76d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:10500:x1876539520102528:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 258us (597us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789607830.278393:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:0.0:1789607830.318680:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.323041:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.323171:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607830.323207:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520103040 00000100:00100000:3.0:1789607830.323216:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520103040 00000100:00100000:3.0:1789607830.323328:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:3.0:1789607830.323338:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520103040:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607830.323454:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520103040:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 116us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607830.323461:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00080000:2.0:1789607830.323999:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607830.331107:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607830.331416:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520102784 00000100:00100000:2.0:1789607830.331458:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520102784 00000100:00100000:2.0:1789607830.331507:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520103296 00000100:00100000:2.0:1789607830.331510:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520103296 00000100:00100000:2.0:1789607830.331540:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 142 00000100:00100000:2.0:1789607830.331549:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520103296:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607830.331625:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520103296:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 76us (8453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607830.331632:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 142 00000100:00100000:2.0:1789607830.331647:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 88 00000100:00100000:2.0:1789607830.331653:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:10020:x1876539520102784:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607830.331679:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607830.331700:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d00138666f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9690 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.331795:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.331810:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d00138665a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9689 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.331819:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.331851:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d00138665a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9689 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.331875:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d00138665a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9689 expref: 23 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607830.331889:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f55a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876539541097984:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607830.331943:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da9c0 going to sleep for 11 seconds 00000100:00080000:2.0:1789607830.331959:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607830.332063:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520102912 00000100:00100000:3.0:1789607830.332068:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520102912 00000100:00100000:3.0:1789607830.332102:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 290 00000100:00100000:3.0:1789607830.332108:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2374:x1876539520102912:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607830.332134:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2374:x1876539520102912:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 26us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607830.332140:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 290 00000100:00100000:0.0:1789607830.333538:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607830.333579:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520103168 00000100:00100000:3.0:1789607830.333586:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520103168 00000100:00080000:0.0:1789607830.333619:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607830.333637:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:3.0:1789607830.333645:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a2016cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2374:x1876539520103168:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607830.333710:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a2016cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2374:x1876539520103168:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 66us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607830.333717:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:0.0:1789607830.339079:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607830.339309:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f55a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876539541097984:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607830.339338:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607830.339458:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520103424 00000100:00100000:3.0:1789607830.339470:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520103424 00010000:00010000:3.0:1789607830.339525:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d00138665a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9689 expref: 24 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607830.339573:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:3.0:1789607830.339602:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5273480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:2373:x1876539520103424:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607830.339622:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607830.339631:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d00138665a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9689 expref: 24 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.339646:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d00138665a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9689 expref: 24 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.339677:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d00138665a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9689 expref: 24 pid: 5848 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.339698:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790600) 00010000:00010000:3.0:1789607830.339704:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.339717:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.339726:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.339760:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607830.339796:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.339832:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607830.339840:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5273480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:2373:x1876539520103424:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 236us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607830.339851:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 47 00000004:00200000:2.0:1789607830.339876:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789607830.340060:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d00138666f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9690 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.340082:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9690 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.340091:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790600) 00010000:00010000:2.0:1789607830.340094:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789607830.340098:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e2800, rc 0) 00000100:00100000:2.0:1789607830.340180:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:10020:x1876539520102784:12345-192.168.202.3@tcp:101:bash.0 Request processed in 8525us (21509us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789607830.340189:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 88 00000100:00100000:0.0:1789607830.348202:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607830.348339:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520103680 00000100:00100000:2.0:1789607830.348354:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520103680 00000100:00100000:2.0:1789607830.348479:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 89 00000100:00100000:2.0:1789607830.348493:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:10020:x1876539520103680:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:2.0:1789607830.348948:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386684 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.348971:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386684 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.348986:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386684 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607830.349066:0:6790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789607830.349098:0:6790:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005976f30f reply state 0000000020de53d6 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386684 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607830.349109:0:6790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789607830.349165:0:6790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789607830.349301:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:10020:x1876539520103680:12345-192.168.202.3@tcp:36:bash.0 Request processed in 809us (1112us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789607830.349310:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 89 00000020:00080000:2.0:1789607830.349318:0:6790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789607830.351143:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386684 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.351173:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386684 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.351181:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386684 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.351186:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3a00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607830.351192:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386684 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.351200:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386684 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.351217:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790600) 00010000:00010000:1.0:1789607830.351220:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607830.351225:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386684 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.351231:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386684 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607830.353857:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607830.354564:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520103808 00000100:00100000:2.0:1789607830.354579:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520103808 00000100:00100000:2.0:1789607830.354665:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 90 00000100:00100000:2.0:1789607830.354677:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:10020:x1876539520103808:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607830.354709:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607830.354737:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138668b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9697 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.354830:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138668b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9697 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.354850:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138668b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9697 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.354886:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790600) 00010000:00010000:2.0:1789607830.354890:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607830.354895:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3200, rc 0) 00000100:00100000:2.0:1789607830.355002:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5271500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:10020:x1876539520103808:12345-192.168.202.3@tcp:101:bash.0 Request processed in 328us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607830.355011:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 90 00000100:00100000:3.0:1789607830.360593:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.360933:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520103936 00000100:00100000:0.0:1789607830.360946:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520103936 00000100:00100000:0.0:1789607830.361022:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:0.0:1789607830.361049:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:10020:x1876539520103936:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1789607830.361074:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607830.361107:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d001386692 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b969e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607830.361143:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aab3f92, atime: 0x6aab3f91, ctime: 0x6aab3f92, blocks: 0xb 00010000:00010000:0.0:1789607830.361172:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:0.0:1789607830.361178:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607830.361188:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d001386692 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b969e expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.361212:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d001386692 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b969e expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.361229:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a400, rc 0) 00000100:00100000:0.0:1789607830.361311:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:10020:x1876539520103936:12345-192.168.202.3@tcp:101:bash.0 Request processed in 278us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607830.361319:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:3.0:1789607830.364577:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607830.364688:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520104064 00000100:00100000:1.0:1789607830.364701:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520104064 00002000:00010000:1.0:1789607830.364757:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789607830.364762:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1c8d9a300 with x1876539520104064 ext(0->18446744073709551615) 00002000:00010000:1.0:1789607830.364778:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1c8d9a300. 00000100:00100000:1.0:1789607830.364816:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:1.0:1789607830.364826:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2373:x1876539520104064:12345-192.168.202.3@tcp:10:bash.0 00002000:00010000:1.0:1789607830.365189:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789607830.365193:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789607826 -> 1789607830 00002000:00010000:1.0:1789607830.365195:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789607825 -> 1789607825 00002000:00010000:1.0:1789607830.365197:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789607826 -> 1789607830 00002000:00010000:1.0:1789607830.365199:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789607830.365284:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2373:x1876539520104064:12345-192.168.202.3@tcp:10:bash.0 Request processed in 457us (722us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789607830.365292:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00002000:00010000:1.0:1789607830.365296:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789607830.365299:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1c8d9a300 with x1876539520104064 ext(0->18446744073709551615) 00002000:00010000:1.0:1789607830.365305:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1c8d9a300. 00000100:00100000:2.0:1789607830.421556:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.421679:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520104192 00000100:00100000:0.0:1789607830.421693:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520104192 00000100:00100000:0.0:1789607830.421773:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 91 00000100:00100000:0.0:1789607830.421786:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:10514:x1876539520104192:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:0.0:1789607830.421929:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386699 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.421951:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.421966:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.421997:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422007:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422014:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422323:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013866a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422334:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013866a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422342:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013866a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607830.422397:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013866a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422411:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422483:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386699 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422490:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386699 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422497:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103bc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607830.422502:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386699 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422511:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386699 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422524:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:0.0:1789607830.422527:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607830.422533:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386699 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422540:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386699 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422554:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422560:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422566:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422571:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607830.422581:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422588:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422595:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1f911da00) 00010000:00010000:0.0:1789607830.422597:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607830.422600:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422606:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422623:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013866a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422629:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013866a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422635:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013866a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422640:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607830.422642:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013866a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422648:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013866a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422654:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790600) 00010000:00010000:0.0:1789607830.422657:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607830.422664:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013866a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.422670:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013866a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607830.422769:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:10514:x1876539520104192:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 983us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607830.422778:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 91 00000100:00100000:3.0:1789607830.460512:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607830.460840:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520104448 00000100:00100000:2.0:1789607830.460855:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520104448 00000100:00100000:2.0:1789607830.460948:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 92 00000100:00100000:2.0:1789607830.460961:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:10517:x1876539520104448:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607830.460992:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607830.461023:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013866ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96a5 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461123:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d0013866b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461142:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d0013866b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461158:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d0013866b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461176:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013866bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461184:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013866bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461192:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013866bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461603:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013866c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461622:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013866c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461630:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013866c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607830.461643:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789607830.461770:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d0013866b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461779:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d0013866b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461787:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d0013866b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461794:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3a00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607830.461799:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d0013866b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461809:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d0013866b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461825:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:2.0:1789607830.461828:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607830.461835:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d0013866b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461843:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d0013866b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461869:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013866bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461884:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013866bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461890:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013866bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461895:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607830.461898:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013866bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461905:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013866bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461914:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1db790700) 00010000:00010000:2.0:1789607830.461917:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607830.461920:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013866bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461926:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013866bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.461984:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013866ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96a5 expref: 30 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.462001:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013866c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96a5 expref: 29 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.462009:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790600) 00010000:00010000:2.0:1789607830.462013:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789607830.462022:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3600, rc 0) 00000100:00100000:2.0:1789607830.462118:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:10517:x1876539520104448:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1159us (1621us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789607830.462127:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 92 00000100:00100000:3.0:1789607830.465676:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.465917:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520104576 00000100:00100000:0.0:1789607830.465932:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520104576 00000100:00100000:0.0:1789607830.466021:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 93 00000100:00100000:0.0:1789607830.466035:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:10517:x1876539520104576:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:0.0:1789607830.466134:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.466159:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9690 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.466171:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.466219:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9690 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.466236:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9690 expref: 29 pid: 5847 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607830.466253:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c5270000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541098112:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607830.466393:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e7fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607830.469236:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c5270000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541098112:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607830.469285:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607830.470693:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.471182:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520104832 00000100:00100000:0.0:1789607830.471196:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520104832 00000100:00100000:0.0:1789607830.471275:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:0.0:1789607830.471288:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:5614:x1876539520104832:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789607830.471769:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:5614:x1876539520104832:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 482us (1085us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789607830.471779:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:0.0:1789607830.474344:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607830.474454:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520104960 00000100:00100000:2.0:1789607830.474466:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520104960 00010000:00010000:2.0:1789607830.474521:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9690 expref: 31 pid: 5847 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607830.474581:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:2.0:1789607830.474592:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:2373:x1876539520104960:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607830.474613:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607830.474623:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9690 expref: 31 pid: 5847 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.474639:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9690 expref: 31 pid: 5847 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.474670:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386676 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9690 expref: 31 pid: 5847 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.474691:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790600) 00010000:00010000:2.0:1789607830.474698:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.474728:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.474738:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.474778:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607830.475073:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5272300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:2373:x1876539520104960:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 481us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607830.475082:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 48 00010000:00010000:0.0:1789607830.475146:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.475155:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.475195:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.475204:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.475211:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.475219:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607830.475224:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.475233:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.475244:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790600) 00010000:00010000:0.0:1789607830.475254:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607830.475260:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.475267:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013866d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607830.475314:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:10517:x1876539520104576:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 9283us (9655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607830.475323:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 93 00000100:00100000:3.0:1789607830.478654:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.478733:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520105216 00000100:00100000:0.0:1789607830.478746:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520105216 00000100:00100000:0.0:1789607830.478842:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:0.0:1789607830.478855:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:10517:x1876539520105216:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1789607830.479748:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:10517:x1876539520105216:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 890us (1107us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789607830.479759:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:3.0:1789607830.563734:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607830.563916:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520105472 00000100:00100000:1.0:1789607830.563930:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520105472 00000100:00100000:1.0:1789607830.564014:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 94 00000100:00100000:1.0:1789607830.564028:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:10528:x1876539520105472:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:1.0:1789607830.564064:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607830.564094:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d0013866d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96ac expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.564225:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013866df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.564242:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013866df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.564257:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013866df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.564275:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013866e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.564282:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013866e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.564290:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013866e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.565805:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013866ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.565828:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013866ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.565841:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013866ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607830.565868:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789607830.566017:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013866df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566041:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013866df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566049:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013866df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566056:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efa00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607830.566061:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013866df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566070:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013866df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566085:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:1.0:1789607830.566089:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607830.566095:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013866df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566102:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013866df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566123:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013866e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566129:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013866e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566136:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013866e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566141:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efe00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607830.566151:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013866e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566158:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013866e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566167:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1dab7d700) 00010000:00010000:1.0:1789607830.566170:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607830.566173:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013866e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566179:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d0013866e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566242:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d0013866d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96ac expref: 33 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566260:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013866ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96ac expref: 32 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.566268:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790600) 00010000:00010000:1.0:1789607830.566270:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607830.566273:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee800, rc 0) 00000100:00100000:1.0:1789607830.566799:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+32:10528:x1876539520105472:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2771us (3076us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789607830.566812:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 94 00000100:00100000:1.0:1789607830.585608:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607830.585850:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520105728 00000100:00100000:2.0:1789607830.585873:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520105728 00000100:00100000:2.0:1789607830.585943:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:2.0:1789607830.585954:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+32:10528:x1876539520105728:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1789607830.586267:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:10528:x1876539520105728:12345-192.168.202.3@tcp:35:cat.0 Request processed in 314us (672us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789607830.586276:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:3.0:1789607830.621213:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607830.621325:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520105984 00000100:00100000:2.0:1789607830.621339:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520105984 00000100:00100000:2.0:1789607830.621494:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 95 00000100:00100000:2.0:1789607830.621506:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:10529:x1876539520105984:12345-192.168.202.3@tcp:36:rm.0 00010000:00010000:2.0:1789607830.621584:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789607830.621619:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d0013866ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96ac expref: 33 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.621648:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d0013866c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96a5 expref: 32 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.621683:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d00138668b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9697 expref: 31 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.621694:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790600) 00010000:00010000:2.0:1789607830.621707:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607830.621733:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013866fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.621749:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013866fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.621760:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013866fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.621776:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386702 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.621783:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.621790:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.622147:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386709 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.622157:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386709 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.622164:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386709 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607830.623138:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1789607830.623152:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364467728354ns, next at 365467724988ns, rc = 0 00010000:00010000:2.0:1789607830.623234:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386710 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623249:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623260:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623269:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386710 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623276:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386710 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623282:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386710 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623530:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607830.623564:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386709 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623571:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386709 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623578:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386709 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623584:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3a00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607830.623597:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386709 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623606:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386709 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623619:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790500) 00010000:00010000:2.0:1789607830.623622:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789607830.623627:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386709 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623634:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386709 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623656:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013866fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623663:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013866fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623669:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013866fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623674:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607830.623677:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013866fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623683:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013866fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623691:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:2.0:1789607830.623694:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607830.623704:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013866fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.623711:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d0013866fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607830.623722:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e4f18aa reply state 00000000bd4844f7 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607830.623732:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607830.623848:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+32:10529:x1876539520105984:12345-192.168.202.3@tcp:36:rm.0 Request processed in 2340us (2645us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1789607830.623869:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 95 00010000:00010000:1.0:1789607830.624898:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607830.624912:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386710 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.624940:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607830.624945:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386710 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.624954:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386710 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.624975:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a1db790500) 00010000:00010000:1.0:1789607830.624978:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789607830.624983:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386710 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.624989:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386710 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.625018:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607830.625020:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607830.625022:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607830.627017:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.627034:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386702 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.627040:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386702 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.627044:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607830.627048:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386702 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.627070:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386702 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.627096:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1db790700) 00010000:00010000:0.0:1789607830.627100:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607830.627106:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386702 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.627113:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386702 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607830.676865:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607830.676912:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520106240 00000100:00100000:1.0:1789607830.676925:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520106240 00000100:00100000:0.0:1789607830.680992:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 96 00000100:00100000:0.0:1789607830.681075:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:10535:x1876539520106240:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1789607830.681116:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607830.681147:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386717 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96b3 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.681315:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138671e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.681337:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138671e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.681351:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138671e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.681374:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386725 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.681397:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386725 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.681407:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386725 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789607830.682294:0:6790:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789607830.682663:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138672c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.682678:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138672c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.682689:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138672c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.683251:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138671e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.683262:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138671e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.683270:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138671e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.683278:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607830.683284:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138671e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.683293:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138671e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.683321:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:0.0:1789607830.683324:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607830.683331:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138671e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.683338:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138671e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607830.683353:0:6790:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001718b0a reply state 00000000c4764c5d transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386725 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607830.683363:0:6790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789607830.683411:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001386717 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96b3 expref: 34 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.683457:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138672c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96b3 expref: 33 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.683465:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:0.0:1789607830.683468:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607830.683470:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b000, rc 0) 00000100:00100000:0.0:1789607830.684676:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:10535:x1876539520106240:12345-192.168.202.3@tcp:101:bash.0 Request processed in 3656us (7819us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789607830.684689:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 96 00000100:00100000:2.0:1789607830.688867:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607830.688904:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520106368 00010000:00010000:2.0:1789607830.688915:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386725 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607830.688921:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520106368 00010000:00010000:2.0:1789607830.688933:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386725 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.688943:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386725 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.688950:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607830.688956:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386725 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.688966:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386725 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.688987:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1f911da00) 00010000:00010000:2.0:1789607830.688991:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789607830.689000:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00010000:00010000:2.0:1789607830.689012:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386725 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607830.689018:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520106368:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607830.689023:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386725 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.689044:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607830.689071:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d00138673a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96ba expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607830.689105:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607830.689213:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:1.0:1789607830.689219:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607830.689230:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d00138673a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96ba expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.689253:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d00138673a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96ba expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.689267:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4efe00, rc 0) 00000100:00100000:1.0:1789607830.689352:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520106368:12345-192.168.202.3@tcp:101:bash.0 Request processed in 338us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607830.689360:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:3.0:1789607830.692180:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.692417:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520106496 00000100:00100000:0.0:1789607830.692464:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520106496 00000100:00100000:0.0:1789607830.692595:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:0.0:1789607830.692607:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:10535:x1876539520106496:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1789607830.692644:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607830.692667:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96c1 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.692705:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d00138673a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96ba expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.692716:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607830.692721:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607830.692727:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 9 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.692770:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d00138673a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96ba expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.692786:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d00138673a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96ba expref: 9 pid: 6695 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607830.692812:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6694:1876539541098240:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607830.692926:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e7f240 going to sleep for 11 seconds 00000100:00100000:2.0:1789607830.696699:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.696840:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6694:1876539541098240:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607830.696900:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 9 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.696930:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103bc00, rc 0) 00000100:00100000:0.0:1789607830.697041:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:10535:x1876539520106496:12345-192.168.202.3@tcp:101:bash.0 Request processed in 4435us (4874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607830.697051:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:3.0:1789607830.698095:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520106624 00000100:00100000:3.0:1789607830.698109:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520106624 00010000:00010000:3.0:1789607830.698152:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d00138673a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96ba expref: 9 pid: 6695 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607830.698193:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:3.0:1789607830.698204:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2373:x1876539520106624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607830.698221:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607830.698252:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d00138673a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96ba expref: 9 pid: 6695 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.698267:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d00138673a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96ba expref: 9 pid: 6695 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.698299:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d00138673a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96ba expref: 9 pid: 6695 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.698318:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607830.698323:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607830.698334:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.698364:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.698417:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607830.698458:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff9e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5832:1876539541098368:192.168.202.3@tcp:105: 00000100:00100000:3.0:1789607830.698558:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607830.719396:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.719487:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff9e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5832:1876539541098368:192.168.202.3@tcp:105: 00010000:00010000:0.0:1789607830.719521:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607830.720080:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520106880 00000100:00100000:2.0:1789607830.720091:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520106880 00000100:00100000:2.0:1789607830.720174:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:2.0:1789607830.720186:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:10535:x1876539520106880:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:2.0:1789607830.720705:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:10535:x1876539520106880:12345-192.168.202.3@tcp:35:bash.0 Request processed in 519us (1324us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789607830.720714:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:0.0:1789607830.720816:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2373:x1876539520106624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 22612us (24132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607830.720828:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000001:00080000:1.0:1789607830.787333:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:1.0:1789607830.787364:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1789607830.892984:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607830.893172:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520107008 00000100:00100000:1.0:1789607830.893187:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520107008 00000100:00100000:1.0:1789607830.893273:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 97 00000100:00100000:1.0:1789607830.893287:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:10552:x1876539520107008:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607830.893322:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607830.893347:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d001386748 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96c8 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.893503:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138674f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.893522:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138674f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.893568:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138674f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607830.893617:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789607830.893621:0:11489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607830.893643:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138674f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.893685:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef400/0x33f091d001386748 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c8 expref: 36 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.893711:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138674f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c8 expref: 35 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.893721:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:1.0:1789607830.893724:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607830.893729:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4efc00, rc 0) 00000100:00100000:1.0:1789607830.893817:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:10552:x1876539520107008:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 532us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607830.893823:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 97 00000100:00100000:1.0:1789607830.899590:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607830.899928:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520107264 00000100:00100000:2.0:1789607830.899967:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520107264 00000100:00100000:2.0:1789607830.900047:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:2.0:1789607830.900059:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:10552:x1876539520107264:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607830.900088:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607830.900115:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d001386756 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96cf expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.900256:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d00138675d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.900275:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d00138675d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.900289:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d00138675d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607830.900324:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789607830.900575:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d001386756 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96cf expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.900601:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d00138675d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96cf expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.900611:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:2.0:1789607830.900615:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607830.900619:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3800, rc 0) 00000100:00100000:2.0:1789607830.902037:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:10552:x1876539520107264:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1962us (2444us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789607830.902053:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:3.0:1789607830.906522:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607830.906582:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607830.906664:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520107648 00000100:00100000:1.0:1789607830.906690:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520107648 00000100:00100000:1.0:1789607830.906781:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:1.0:1789607830.906794:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:2373:x1876539520107648:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607830.906828:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607830.906874:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d00138675d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96cf expref: 37 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.906921:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:1.0:1789607830.906928:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607830.907052:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520107520 00000100:00100000:0.0:1789607830.907057:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520107520 00000100:00100000:0.0:1789607830.907094:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00100000:0.0:1789607830.907100:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:10552:x1876539520107520:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607830.907125:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607830.907143:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138676b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96d6 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.907260:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386772 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.907277:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386772 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.907290:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386772 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607830.907304:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789607830.907485:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a000/0x33f091d00138676b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96d6 expref: 40 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.907514:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386772 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96d6 expref: 39 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.907522:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:0.0:1789607830.907524:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789607830.907527:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a200, rc 0) 00000100:00100000:1.0:1789607830.908307:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+39:2373:x1876539520107648:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1507us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607830.908320:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:0.0:1789607830.908397:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:10552:x1876539520107520:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1294us (1891us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789607830.908406:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00100000:3.0:1789607830.915615:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.916275:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520107776 00000100:00100000:0.0:1789607830.916290:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520107776 00000100:00100000:0.0:1789607830.916410:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:0.0:1789607830.916464:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2375:x1876539520107776:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:0.0:1789607830.916532:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.916627:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.916637:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607830.916642:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607830.916648:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.916768:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.916883:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 6 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607830.916902:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876539541098496:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607830.917022:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e4dc3600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607830.922112:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607830.922647:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520107904 00000100:00100000:3.0:1789607830.922662:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520107904 00002000:00100000:3.0:1789607830.922867:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99a1f55a8a80 x1876539520107904/t0(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:386/0 lens 504/0 e 0 to 0 dl 1789607841 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789607830.922881:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1f55a8a80 with x1876539520107904 ext(0->8) 00010000:00010000:3.0:1789607830.922894:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 7 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.922916:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 7 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789607830.922927:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99a1f55a8a80 00000100:00100000:3.0:1789607830.922963:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:3.0:1789607830.922976:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520107904:12345-192.168.202.3@tcp:4:lfs.0 00000100:00100000:3.0:1789607830.924284:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2374:x1876539520107904:12345-192.168.202.3@tcp:4:lfs.0 Request processed in 1299us (2174us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789607830.924297:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00002000:00100000:3.0:1789607830.924309:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99a1f55a8a80 x1876539520107904/t4294967302(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:386/0 lens 504/448 e 0 to 0 dl 1789607841 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789607830.924321:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1f55a8a80 with x1876539520107904 ext(0->8) 00010000:00010000:3.0:1789607830.924331:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 9 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.924348:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 9 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789607830.924357:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99a1f55a8a80 00010000:00010000:1.0:1789607830.924605:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607830.924852:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876539541098496:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607830.924897:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607830.928402:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607830.928656:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520108032 00000100:00100000:2.0:1789607830.928746:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520108032 00010000:00010000:2.0:1789607830.928918:0:8517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 9 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607830.929034:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:2.0:1789607830.929049:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2376:x1876539520108032:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607830.929072:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789607830.929102:0:8517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789607830.929106:0:8517:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789607830 00002000:00010000:2.0:1789607830.929109:0:8517:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789607830 00002000:00010000:2.0:1789607830.929111:0:8517:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789607830 00010000:00010000:2.0:1789607830.929139:0:8517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 9 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.929156:0:8517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 9 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.929190:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d23e311/0x33f091d001386741 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c1 expref: 9 pid: 6694 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.929214:0:8517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607830.929220:0:8517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607830.929229:0:8517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.929241:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607830.929285:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607830.929372:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2376:x1876539520108032:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 327us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607830.929382:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 50 00010000:00010000:1.0:1789607830.930903:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.930929:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.930988:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.930998:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.931008:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.931017:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0030200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607830.931022:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.931058:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.931083:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.931091:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba8fafe3/0x33f091d001386780 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607830.931231:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2375:x1876539520107776:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 14805us (15625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607830.931243:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:1.0:1789607830.935134:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607830.935250:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520108288 00000100:00100000:3.0:1789607830.935266:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520108288 00000100:00100000:3.0:1789607830.935332:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:3.0:1789607830.935345:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1db76c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:10552:x1876539520108288:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:3.0:1789607830.935475:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386772 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96d6 expref: 38 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607830.936015:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1789607830.936067:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1789607830.936484:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1789607830.937066:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.937091:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138672c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96b3 expref: 42 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.937122:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.937175:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138672c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96b3 expref: 42 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607830.937197:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138672c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96b3 expref: 42 pid: 6790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607830.937215:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5850:1876539541098624:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607830.937384:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c95a0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607830.941156:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.941654:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520108416 00000100:00100000:0.0:1789607830.941667:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520108416 00010000:00010000:0.0:1789607830.941721:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138672c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96b3 expref: 43 pid: 6790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607830.941778:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:0.0:1789607830.941790:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+43:2373:x1876539520108416:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607830.941821:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607830.941830:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138672c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96b3 expref: 43 pid: 6790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.941845:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138672c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96b3 expref: 43 pid: 6790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.941884:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:0.0:1789607830.941909:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.941920:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.941930:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.941958:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607830.942143:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+43:2373:x1876539520108416:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 353us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607830.942152:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 51 00010000:00010000:2.0:1789607830.943766:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d00138672c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96b3 expref: 42 pid: 6790 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607830.943900:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5850:1876539541098624:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607830.943933:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.944233:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607830.944242:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607830.944528:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789607830.944974:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789607830.945123:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1876539541098752:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789607830.945415:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607830.945720:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da840 going to sleep for 11 seconds 00000100:00100000:2.0:1789607830.945777:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541098752 00000100:00100000:2.0:1789607830.945787:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541098752 00000100:00100000:2.0:1789607830.945998:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607830.946010:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876539541098752:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789607830.946132:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876539541098752:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 124us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607830.946141:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607830.946283:0:5850:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789607830.946291:0:5850:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1789607830.946315:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a1c8d9aa00, transno 4294967301 00000100:00100000:1.0:1789607830.946336:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1876539541098752:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789607830.947015:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789607830.947112:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b48700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1876539541098880:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789607830.947171:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607830.947202:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e4dc3600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607830.947311:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541098880 00000100:00100000:2.0:1789607830.947319:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541098880 00000100:00100000:2.0:1789607830.947369:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607830.947378:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876539541098880:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789607830.947593:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1876539541098880:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 216us (421us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789607830.947601:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607830.948332:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b48700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1876539541098880:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789607830.948417:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1789607830.948509:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.948656:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.948667:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.948675:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607830.948680:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.948690:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.948709:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:1.0:1789607830.948712:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789607830.948719:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.948725:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386787 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789607830.949036:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789607830.949149:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1789607830.949163:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 364793739058ns, next at 365793736237ns, rc = 0 00000001:00080000:1.0:1789607830.949171:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1789607830.949217:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:1.0:1789607830.949220:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789607830.949229:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386772 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96d6 expref: 46 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607830.949508:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1db76c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+45:10552:x1876539520108288:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 14164us (14390us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1789607830.949521:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 26 00000020:00080000:1.0:1789607830.949528:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1789607830.949810:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607830.952943:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607830.953092:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520108544 00000100:00100000:1.0:1789607830.953105:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520108544 00000100:00100000:1.0:1789607830.953187:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 100 00000100:00100000:1.0:1789607830.953200:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+45:10552:x1876539520108544:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607830.953234:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607830.953267:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138678e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.953349:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138678e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96dd expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.953372:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138678e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96dd expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607830.953395:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:1.0:1789607830.953398:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789607830.953404:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee200, rc 0) 00000100:00100000:1.0:1789607830.953504:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+46:10552:x1876539520108544:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 306us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607830.953512:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 100 00000100:00100000:3.0:1789607830.956987:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607830.957238:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520108800 00000100:00100000:0.0:1789607830.957252:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520108800 00000100:00100000:0.0:1789607830.957324:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:0.0:1789607830.957337:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+46:10552:x1876539520108800:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1789607830.957694:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+47:10552:x1876539520108800:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 358us (731us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789607830.957723:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:0.0:1789607831.024596:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607831.024693:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520108928 00000100:00100000:2.0:1789607831.024706:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520108928 00000100:00100000:2.0:1789607831.024778:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 101 00000100:00100000:2.0:1789607831.024789:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+47:10562:x1876539520108928:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:2.0:1789607831.024913:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386795 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.024936:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386795 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.024950:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386795 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.024990:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d00138679c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.024998:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d00138679c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025005:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d00138679c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025129:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013867a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025138:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013867a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025145:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013867a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607831.025199:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013867a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025214:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386795 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025222:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386795 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025230:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386795 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025236:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3c00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607831.025241:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386795 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025257:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386795 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025273:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:2.0:1789607831.025276:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607831.025283:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386795 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025289:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386795 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025306:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d00138679c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025313:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d00138679c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025321:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d00138679c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025326:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607831.025329:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d00138679c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025677:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d00138679c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025689:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1db790d00) 00010000:00010000:2.0:1789607831.025692:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607831.025695:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d00138679c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025713:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d00138679c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025732:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013867a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025737:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013867a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025744:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013867a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025749:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607831.025752:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013867a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025758:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013867a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025765:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:2.0:1789607831.025767:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607831.025769:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013867a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.025775:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d0013867a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607831.025889:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5271f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+47:10562:x1876539520108928:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 1099us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607831.025899:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 101 00000100:00100000:2.0:1789607831.055304:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.055788:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520109184 00000100:00100000:0.0:1789607831.056070:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520109184 00000100:00100000:0.0:1789607831.056226:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 102 00000100:00100000:0.0:1789607831.056238:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+47:10565:x1876539520109184:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607831.056269:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607831.056296:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96e4 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.056400:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d0013867b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.056457:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d0013867b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.056474:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d0013867b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.056493:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d0013867b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.056501:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d0013867b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.056508:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d0013867b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.056932:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d0013867bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.056963:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d0013867bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.056971:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d0013867bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607831.056996:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789607831.058318:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d0013867b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058334:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d0013867b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058342:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d0013867b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058349:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0030200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.058355:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d0013867b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058365:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d0013867b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058382:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:0.0:1789607831.058386:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607831.058392:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d0013867b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058399:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d0013867b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058419:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d0013867b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058545:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d0013867b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058552:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d0013867b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058557:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0030a00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.058560:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d0013867b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058567:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d0013867b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058577:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1f911d600) 00010000:00010000:0.0:1789607831.058580:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607831.058597:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d0013867b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058603:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d0013867b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058673:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96e4 expref: 50 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058691:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d0013867bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96e4 expref: 49 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.058699:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:0.0:1789607831.058701:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607831.058711:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c0031000, rc 0) 00000100:00100000:0.0:1789607831.058830:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+49:10565:x1876539520109184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2593us (3540us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789607831.058840:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 102 00000100:00100000:0.0:1789607831.063392:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607831.063904:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520109312 00000100:00100000:3.0:1789607831.063921:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520109312 00000100:00100000:3.0:1789607831.064127:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 103 00000100:00100000:3.0:1789607831.064141:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+49:10565:x1876539520109312:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:3.0:1789607831.064243:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.064273:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.064289:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.064325:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.064354:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.064361:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.064368:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fe00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607831.064374:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.064383:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.064399:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:3.0:1789607831.064402:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607831.064409:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.064415:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.064554:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+49:10565:x1876539520109312:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 415us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607831.064562:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 103 00000100:00100000:2.0:1789607831.067660:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.067916:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520109568 00000100:00100000:0.0:1789607831.067929:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520109568 00000100:00100000:0.0:1789607831.067994:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:0.0:1789607831.068006:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+49:10565:x1876539520109568:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1789607831.068515:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+50:10565:x1876539520109568:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 510us (870us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789607831.068525:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:2.0:1789607831.135882:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607831.136085:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520109824 00000100:00100000:3.0:1789607831.136340:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520109824 00000100:00100000:3.0:1789607831.136526:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 104 00000100:00100000:3.0:1789607831.136550:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+50:10575:x1876539520109824:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1789607831.136587:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607831.136610:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789607831.136646:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138674f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96c8 expref: 50 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.136674:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:3.0:1789607831.136680:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607831.136697:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013867d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96eb expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.136830:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.136848:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d0013867bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96e4 expref: 50 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.136867:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.136910:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d0013867bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96e4 expref: 50 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.136926:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d0013867bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96e4 expref: 50 pid: 11489 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.136943:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541099008:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607831.137521:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c95a09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607831.142882:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.143027:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520109952 00000100:00100000:0.0:1789607831.143040:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520109952 00010000:00010000:0.0:1789607831.143099:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d0013867bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96e4 expref: 51 pid: 11489 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.143158:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:0.0:1789607831.143170:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+51:2374:x1876539520109952:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607831.143194:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607831.143202:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d0013867bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96e4 expref: 51 pid: 11489 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.143219:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d0013867bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96e4 expref: 51 pid: 11489 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.143249:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:0.0:1789607831.143284:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.143296:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.143306:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.143332:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607831.143408:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+51:2374:x1876539520109952:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 240us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.143416:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 52 00010000:00010000:3.0:1789607831.144622:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d0013867bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96e4 expref: 50 pid: 11489 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.144676:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541099008:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607831.144706:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.144718:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.144725:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607831.144754:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789607831.145115:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013867d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96eb expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.145134:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96eb expref: 50 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.145143:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:3.0:1789607831.145147:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789607831.145150:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558fe00, rc 0) 00000100:00100000:3.0:1789607831.145380:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+50:10575:x1876539520109824:12345-192.168.202.3@tcp:101:bash.0 Request processed in 8842us (9527us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789607831.145390:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 104 00000100:00100000:2.0:1789607831.148336:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.148467:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520110208 00000100:00100000:0.0:1789607831.148481:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520110208 00000100:00100000:0.0:1789607831.148559:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 105 00000100:00100000:0.0:1789607831.148571:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+50:10575:x1876539520110208:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:0.0:1789607831.149217:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.149240:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.149254:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607831.150091:0:11489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1789607831.150156:0:11489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007435362 reply state 000000004cce38b5 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.150169:0:11489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789607831.151104:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+53:10575:x1876539520110208:12345-192.168.202.3@tcp:36:bash.0 Request processed in 2528us (2845us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789607831.151118:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 105 00000020:00080000:0.0:1789607831.151126:0:11489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789607831.153894:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:0.0:1789607831.154465:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.154483:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.154492:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.154499:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0031600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.154506:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.154516:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.154628:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:0.0:1789607831.154633:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607831.154640:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.154648:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.154869:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520110336 00000100:00100000:3.0:1789607831.154884:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520110336 00000100:00100000:3.0:1789607831.155097:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 106 00000100:00100000:3.0:1789607831.155112:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+52:10575:x1876539520110336:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1789607831.155170:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607831.155197:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d0013867f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96f2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.155326:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.155343:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96eb expref: 53 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.155352:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.155398:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96eb expref: 53 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.155416:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96eb expref: 53 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.155469:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541099136:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607831.155591:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c95a0480 going to sleep for 11 seconds 00000100:00100000:1.0:1789607831.162370:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607831.162511:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541099136:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607831.162566:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.163371:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520110464 00000100:00100000:0.0:1789607831.163385:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520110464 00010000:00010000:0.0:1789607831.163480:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96eb expref: 54 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.163564:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:0.0:1789607831.163577:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+54:2373:x1876539520110464:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607831.163598:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607831.163608:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96eb expref: 54 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.163625:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96eb expref: 54 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.163660:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013867db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96eb expref: 54 pid: 5849 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.163681:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:0.0:1789607831.163687:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.163701:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.163712:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.163756:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607831.163848:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+53:2373:x1876539520110464:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 274us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.163866:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 53 00010000:00010000:1.0:1789607831.163967:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.163987:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607831.164057:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789607831.164063:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607831.164096:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.164137:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d0013867f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96f2 expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.164154:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96f2 expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.164161:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:1.0:1789607831.164164:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607831.164166:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f800, rc 0) 00000100:00100000:1.0:1789607831.164196:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+52:10575:x1876539520110336:12345-192.168.202.3@tcp:101:bash.0 Request processed in 9090us (10321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.164203:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 106 00000100:00100000:2.0:1789607831.170257:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607831.170558:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520110720 00000100:00100000:1.0:1789607831.170572:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520110720 00000100:00100000:1.0:1789607831.170644:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:1.0:1789607831.170657:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+52:10575:x1876539520110720:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:1.0:1789607831.171643:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+53:10575:x1876539520110720:12345-192.168.202.3@tcp:35:bash.0 Request processed in 983us (1396us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1789607831.171656:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:1.0:1789607831.179936:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c527c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541099648:0@lo:400:kworker.0 00000100:00100000:1.0:1789607831.180036:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607831.180091:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789607831.180097:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c527e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541099264:0@lo:400:kworker.0 00000100:00100000:1.0:1789607831.180130:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607831.180160:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c527c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541099776:0@lo:400:kworker.0 00000100:00100000:1.0:1789607831.180191:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607831.180219:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c527ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541099520:0@lo:400:kworker.0 00000100:00100000:1.0:1789607831.180244:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607831.180278:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789607831.180283:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c527d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541099392:0@lo:400:kworker.0 00000100:00100000:1.0:1789607831.180308:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607831.180324:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c527dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541099904:0@lo:400:kworker.0 00000100:00100000:1.0:1789607831.180344:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607831.180374:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541099648 00000100:00100000:1.0:1789607831.180384:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541099648 00000100:00100000:1.0:1789607831.180471:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541099904 00000100:00100000:1.0:1789607831.180474:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541099904 00000100:00100000:1.0:1789607831.180513:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789607831.180523:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876539541099648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607831.180585:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876539541099648:12345-0@lo:400:kworker.0 Request processed in 63us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.180592:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789607831.180618:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789607831.180625:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541099904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607831.180660:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541099904:12345-0@lo:400:kworker.0 Request processed in 36us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.180678:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789607831.180727:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c527dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541099904:0@lo:400:kworker.0 00000100:00100000:1.0:1789607831.180762:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c527c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541099648:0@lo:400:kworker.0 00000100:00100000:1.0:1789607831.180781:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541099776 00000100:00100000:1.0:1789607831.180785:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541099776 00000100:00080000:0.0:1789607831.181061:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607831.181077:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607831.181091:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541099520 00000100:00100000:0.0:1789607831.181095:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541099520 00000100:00100000:0.0:1789607831.181137:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541099392 00000100:00100000:0.0:1789607831.181141:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541099392 00000100:00100000:0.0:1789607831.181163:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789607831.181170:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541099520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607831.181220:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541099520:12345-0@lo:400:kworker.0 Request processed in 51us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.181227:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789607831.181241:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789607831.181249:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541099392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607831.181291:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541099392:12345-0@lo:400:kworker.0 Request processed in 44us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.181297:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:0.0:1789607831.181311:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607831.181332:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c527d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541099392:0@lo:400:kworker.0 00000100:00100000:0.0:1789607831.181342:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c527ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541099520:0@lo:400:kworker.0 00000100:00100000:1.0:1789607831.181641:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789607831.181650:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541099776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607831.181694:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541099776:12345-0@lo:400:kworker.0 Request processed in 47us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.181700:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789607831.181731:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c527c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541099776:0@lo:400:kworker.0 00000100:00100000:3.0:1789607831.181837:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541099264 00000100:00100000:3.0:1789607831.181843:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541099264 00000100:00100000:3.0:1789607831.181896:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789607831.181917:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541099264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607831.181973:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541099264:12345-0@lo:400:kworker.0 Request processed in 59us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607831.181981:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789607831.182030:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c527e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541099264:0@lo:400:kworker.0 00000100:00100000:2.0:1789607831.241775:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.241951:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520110848 00000100:00100000:0.0:1789607831.241965:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520110848 00000100:00100000:0.0:1789607831.242046:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 107 00000100:00100000:0.0:1789607831.242067:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+53:10581:x1876539520110848:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607831.242102:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607831.242131:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b96f9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.242221:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386805 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.242257:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.242273:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607831.242321:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789607831.242326:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607831.242363:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386805 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.245419:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d0013867fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96f9 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.245492:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386805 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96f9 expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.245506:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:0.0:1789607831.245510:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607831.245516:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c0030a00, rc 0) 00000100:00100000:0.0:1789607831.245649:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+54:10581:x1876539520110848:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 3590us (3887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.245661:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 107 00000100:00100000:2.0:1789607831.252674:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607831.253475:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520110976 00000100:00100000:1.0:1789607831.253495:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520110976 00000100:00100000:1.0:1789607831.253591:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 108 00000100:00100000:1.0:1789607831.253604:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+54:10581:x1876539520110976:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607831.253633:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607831.253663:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d00138680c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9700 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.253758:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d001386813 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.253778:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d001386813 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.253793:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d001386813 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.253832:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d00138681a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.253840:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d00138681a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.253848:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d00138681a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.253998:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386821 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.254009:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.254016:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607831.254144:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789607831.254150:0:6790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607831.254176:0:6790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.254190:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386821 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.254200:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d001386813 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.254207:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d001386813 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.254225:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d001386813 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.254232:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607831.254237:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d001386813 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.254246:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d001386813 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.255378:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:1.0:1789607831.255390:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607831.255401:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d001386813 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.255412:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d001386813 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.255450:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d00138681a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.255457:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d00138681a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.255464:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d00138681a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.255481:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607831.255486:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d00138681a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.255511:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d00138681a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.255526:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1dab7df00) 00010000:00010000:1.0:1789607831.255528:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607831.255532:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d00138681a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.255539:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d00138681a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.255595:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d00138680c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9700 expref: 56 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.255613:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386821 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9700 expref: 55 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.255622:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:1.0:1789607831.255624:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607831.255627:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4eec00, rc 0) 00000100:00100000:1.0:1789607831.255730:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:10581:x1876539520110976:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2127us (3072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.255740:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 108 00000100:00100000:2.0:1789607831.262357:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607831.262496:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607831.262823:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520111104 00000100:00100000:3.0:1789607831.262825:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520111360 00000100:00100000:1.0:1789607831.262835:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520111104 00000100:00100000:3.0:1789607831.262836:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520111360 00000100:00100000:3.0:1789607831.262923:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 109 00000100:00100000:1.0:1789607831.262926:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1789607831.262938:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+56:10581:x1876539520111360:12345-192.168.202.3@tcp:101:lfs.0 00000100:00100000:1.0:1789607831.262946:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+56:2373:x1876539520111104:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607831.262967:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607831.262992:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607831.263001:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386828 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9707 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.263026:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386821 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9700 expref: 57 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.263054:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:1.0:1789607831.263073:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607831.263150:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+56:2373:x1876539520111104:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 214us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.263159:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00010000:00010000:3.0:1789607831.263161:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.263180:0:11489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96f2 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.263191:0:11489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.263234:0:11489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96f2 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.263251:0:11489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96f2 expref: 55 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.263288:0:11489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541100032:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607831.263386:0:11489:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c95a09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607831.267932:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607831.268058:0:11489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541100032:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607831.268111:0:11489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.268252:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520111488 00000100:00100000:0.0:1789607831.268274:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520111488 00010000:00010000:0.0:1789607831.268322:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96f2 expref: 56 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.268369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00100000:0.0:1789607831.268401:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+56:2374:x1876539520111488:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607831.268462:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607831.268472:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96f2 expref: 56 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.268488:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96f2 expref: 56 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.268518:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013867f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96f2 expref: 56 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.269758:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:0.0:1789607831.269776:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.269791:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.269801:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.269961:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607831.270079:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c70050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:2374:x1876539520111488:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 1669us (2151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.270092:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 54 00010000:00010000:3.0:1789607831.271730:0:11489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.271750:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607831.271787:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789607831.272247:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386828 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9707 expref: 56 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.272355:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9707 expref: 55 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.272367:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:3.0:1789607831.272370:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789607831.272375:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558ee00, rc 0) 00000100:00100000:3.0:1789607831.273130:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:10581:x1876539520111360:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 10189us (10628us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789607831.273142:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 109 00000100:00100000:2.0:1789607831.279918:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607831.280247:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520111744 00000100:00100000:1.0:1789607831.280322:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520111744 00000100:00100000:1.0:1789607831.280672:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1789607831.280688:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:10581:x1876539520111744:12345-192.168.202.3@tcp:103:lfs.0 00010000:00010000:1.0:1789607831.280709:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607831.280743:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d00138678e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96dd expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.280769:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:1.0:1789607831.280776:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607831.280915:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+54:10581:x1876539520111744:12345-192.168.202.3@tcp:103:lfs.0 Request processed in 231us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.280933:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:2.0:1789607831.288398:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.288545:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520111872 00000100:00100000:0.0:1789607831.288559:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520111872 00000100:00100000:0.0:1789607831.288681:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 110 00000100:00100000:0.0:1789607831.288694:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+54:10581:x1876539520111872:12345-192.168.202.3@tcp:58:lfs.0 00010000:00010000:0.0:1789607831.288888:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d00138683d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.288910:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d00138683d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.289320:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d00138683d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607831.289612:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789607831.289740:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+54:10581:x1876539520111872:12345-192.168.202.3@tcp:58:lfs.0 Request processed in 1045us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.289750:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 110 00000100:00100000:2.0:1789607831.293592:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607831.293835:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520112000 00000100:00100000:1.0:1789607831.293848:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520112000 00000100:00100000:1.0:1789607831.293940:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 111 00000100:00100000:1.0:1789607831.293952:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+54:10581:x1876539520112000:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607831.294004:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607831.294035:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386844 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b970e expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.294127:0:6790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d00138683d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.294141:0:6790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386844 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b970e expref: 55 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.294165:0:6790:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d00138683d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.294180:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386844 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b970e expref: 55 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.294197:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:1.0:1789607831.294201:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789607831.294205:0:6790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386844 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b970e expref: 55 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.294213:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee200, rc 0) 00000100:00100000:1.0:1789607831.294830:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:10581:x1876539520112000:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 874us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.294840:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 111 00000040:00080000:3.0:1789607831.627783:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607831.627835:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607831.627932:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789607831.627942:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789607831.628123:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1876539541100160:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789607831.628293:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607831.633250:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1876539541100160:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789607831.637609:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607831.637909:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520112128 00000100:00100000:3.0:1789607831.637925:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520112128 00000100:00100000:3.0:1789607831.638018:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 112 00000100:00100000:3.0:1789607831.638032:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:10582:x1876539520112128:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789607831.638078:0:11489:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789607831.638495:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:10582:x1876539520112128:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 465us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607831.638504:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 112 00000100:00100000:3.0:1789607831.651993:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.652138:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520112256 00000100:00100000:0.0:1789607831.652152:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520112256 00000100:00100000:0.0:1789607831.652246:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:0.0:1789607831.652259:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:10582:x1876539520112256:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789607831.652362:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d00138684b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652385:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d00138684b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652399:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d00138684b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652418:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386852 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652463:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652489:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652519:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386859 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652528:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652536:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607831.652588:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789607831.652593:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607831.652609:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652622:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d00138684b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652630:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d00138684b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652638:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d00138684b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652644:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0030200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.652649:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d00138684b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652657:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d00138684b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652678:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1f911d000) 00010000:00010000:0.0:1789607831.652681:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607831.652687:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d00138684b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652694:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d00138684b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652711:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652718:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386852 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652724:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386852 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652729:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0031000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.652732:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386852 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652738:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386852 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652744:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff99a1f911d600) 00010000:00010000:0.0:1789607831.652746:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607831.652749:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386852 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652754:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386852 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652783:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386859 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652801:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386859 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652808:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652813:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.652816:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652822:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386859 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652830:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:0.0:1789607831.652833:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607831.652836:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386859 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.652843:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001386859 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.652949:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:10582:x1876539520112256:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 Request processed in 691us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.652957:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 113 00000100:00100000:2.0:1789607831.663527:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607831.663653:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520112512 00000100:00100000:1.0:1789607831.663668:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520112512 00000100:00100000:1.0:1789607831.663750:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:1.0:1789607831.663763:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:10582:x1876539520112512:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607831.663826:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607831.663867:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386860 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9715 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.664017:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386867 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.664036:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.664052:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607831.664068:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789607831.664217:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386867 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.664226:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386867 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.664234:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.664241:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607831.664247:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386867 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.664256:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386867 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.664272:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:1.0:1789607831.664283:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789607831.664292:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386867 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.664299:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386867 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.664358:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386860 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9715 expref: 57 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.664370:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1f911d000) 00010000:00010000:1.0:1789607831.664372:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607831.664376:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386860 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9715 expref: 57 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.664387:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4eec00, rc 0) 00000100:00100000:1.0:1789607831.664534:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+56:10582:x1876539520112512:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 774us (1022us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1789607831.664543:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 114 00000100:00100000:3.0:1789607831.667582:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.667859:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520112640 00000100:00100000:0.0:1789607831.667872:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520112640 00000100:00100000:0.0:1789607831.667947:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:0.0:1789607831.667973:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+56:10582:x1876539520112640:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789607831.668024:0:11489:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789607831.668164:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+56:10582:x1876539520112640:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 185us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.668173:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 115 00000100:00100000:3.0:1789607831.673343:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607831.673605:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520112896 00000100:00100000:1.0:1789607831.673618:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520112896 00000100:00100000:1.0:1789607831.673696:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 116 00000100:00100000:1.0:1789607831.673707:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+56:10582:x1876539520112896:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607831.673737:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607831.673742:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789607831.673784:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386805 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b96f9 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.673818:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:1.0:1789607831.673841:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607831.673870:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386875 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b971c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789607831.674704:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789607831.675871:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d00138687c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.675896:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d00138687c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.675912:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d00138687c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.676524:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386875 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b971c expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.676624:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d00138687c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b971c expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.676636:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1dab7df00) 00010000:00010000:1.0:1789607831.676640:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607831.676644:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef600, rc 0) 00000100:00100000:1.0:1789607831.676871:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+57:10582:x1876539520112896:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 3162us (3542us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789607831.676882:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 116 00000100:00100000:2.0:1789607831.683506:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.683715:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520113152 00000100:00100000:0.0:1789607831.683729:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520113152 00000100:00100000:0.0:1789607831.683805:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 117 00000100:00100000:0.0:1789607831.683817:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+57:10582:x1876539520113152:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789607831.683905:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607831.683941:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d00138687c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b971c expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.683970:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1dab7df00) 00010000:00010000:0.0:1789607831.683996:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607831.684026:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138688a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684042:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138688a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684054:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138688a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684069:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386891 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3ab9aff0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684076:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ab9aff0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684105:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ab9aff0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684198:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138688a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684205:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138688a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684212:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138688a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684218:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.684223:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138688a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684233:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138688a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684242:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:0.0:1789607831.684245:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607831.684249:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138688a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684256:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138688a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684265:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386891 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ab9aff0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684270:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386891 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ab9aff0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684282:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ab9aff0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684287:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.684290:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386891 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ab9aff0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684296:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386891 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3ab9aff0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684302:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3ab9aff0 (ffff99a1f911d600) 00010000:00010000:0.0:1789607831.684304:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607831.684307:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386891 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3ab9aff0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.684312:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d001386891 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3ab9aff0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.684416:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+56:10582:x1876539520113152:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 600us (925us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789607831.684450:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 117 00000100:00100000:3.0:1789607831.691261:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000004:00080000:3.0:1789607831.691877:0:7982:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365536452177ns, next at 366536448974ns, rc = 0 00000100:00100000:2.0:1789607831.691961:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607831.691989:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541100288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607831.692073:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607831.692313:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541100288 00000100:00100000:3.0:1789607831.692323:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541100288 00000100:00100000:1.0:1789607831.692479:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520113280 00000100:00100000:1.0:1789607831.692485:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520113280 00000100:00100000:1.0:1789607831.692529:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:1.0:1789607831.692554:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+56:10582:x1876539520113280:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607831.692654:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607831.692691:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386898 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9723 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.692742:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d00138689f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.692761:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d00138689f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.692778:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d00138689f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.692933:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386898 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9723 expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.692962:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d00138689f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9723 expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.692972:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1dab7db00) 00010000:00010000:1.0:1789607831.692976:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789607831.692981:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef000, rc 0) 00000100:00100000:1.0:1789607831.693046:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+57:10582:x1876539520113280:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 494us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.693053:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 118 00000100:00100000:3.0:1789607831.693391:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789607831.693403:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541100288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607831.693461:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607831.693523:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541100288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607831.693543:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789607831.693958:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541100288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607831.697833:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607831.698365:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520113536 00000100:00100000:3.0:1789607831.698379:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520113536 00000100:00100000:3.0:1789607831.698824:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 119 00000100:00100000:3.0:1789607831.698841:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+57:10582:x1876539520113536:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789607831.699161:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.699187:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.699203:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607831.699647:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:3.0:1789607831.699767:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca95aa45 reply state 00000000c07eaf60 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.699780:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607831.701130:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+59:10582:x1876539520113536:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 2282us (3299us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1789607831.701144:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 119 00000100:00100000:3.0:1789607831.705221:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1789607831.705869:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.705906:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868a6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.705915:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.705923:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558e000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607831.705929:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.705938:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.705959:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1dab7db00) 00010000:00010000:1.0:1789607831.705963:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789607831.705969:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868a6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.705976:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.706169:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520113664 00000100:00100000:0.0:1789607831.706184:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520113664 00000100:00100000:0.0:1789607831.706266:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00100000:0.0:1789607831.706280:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+58:10582:x1876539520113664:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607831.706315:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607831.706344:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013868ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b972a expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.710218:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013868ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b972a expref: 59 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.710252:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013868ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b972a expref: 59 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.710302:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1dab7db00) 00010000:00010000:0.0:1789607831.710306:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607831.710312:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b000, rc 0) 00000100:00100000:0.0:1789607831.710500:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+59:10582:x1876539520113664:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 4220us (5291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.710511:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 120 00000100:00100000:2.0:1789607831.720739:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607831.720907:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520113792 00000100:00100000:1.0:1789607831.720921:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520113792 00000100:00100000:1.0:1789607831.720999:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:1.0:1789607831.721013:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2373:x1876539520113792:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789607831.722011:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2373:x1876539520113792:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 994us (1281us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789607831.722024:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:2.0:1789607831.728625:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.730307:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520114048 00000100:00100000:0.0:1789607831.730329:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520114048 00000100:00100000:1.0:1789607831.730615:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:1.0:1789607831.730654:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+59:10582:x1876539520114048:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789607831.730866:0:5851:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1789607831.730879:0:5851:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1789607831.731586:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+60:10582:x1876539520114048:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 934us (2975us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789607831.731597:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:0.0:1789607831.738360:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607831.744290:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520114304 00000100:00100000:2.0:1789607831.744315:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520114304 00000100:00100000:2.0:1789607831.744471:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 121 00000100:00100000:2.0:1789607831.744487:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+60:10582:x1876539520114304:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789607831.744667:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+60:10582:x1876539520114304:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 184us (6321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607831.744694:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 121 00000100:00100000:2.0:1789607831.747922:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607831.748073:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520114432 00000100:00100000:3.0:1789607831.748088:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520114432 00000100:00100000:3.0:1789607831.748166:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 122 00000100:00100000:3.0:1789607831.748178:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+60:10582:x1876539520114432:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607831.748204:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607831.748252:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9731 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.748370:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.748391:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.748407:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607831.748512:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607831.748551:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.748588:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9731 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.748608:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9731 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.748618:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1dab7db00) 00010000:00010000:3.0:1789607831.748621:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789607831.748626:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e000, rc 0) 00000100:00100000:3.0:1789607831.748707:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:10582:x1876539520114432:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 530us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607831.748715:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 122 00000100:00100000:2.0:1789607831.752088:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607831.752257:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520114560 00000100:00100000:1.0:1789607831.752271:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520114560 00000100:00100000:1.0:1789607831.752344:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:1.0:1789607831.752356:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2376:x1876539520114560:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607831.752381:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607831.752416:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a908035e/0x33f091d0013868c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9738 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607831.752476:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab3f97, blocks: 0x1 00010000:00010000:1.0:1789607831.752506:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1789607831.752512:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607831.752524:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a908035e/0x33f091d0013868c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9738 expref: 10 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.752560:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a908035e/0x33f091d0013868c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9738 expref: 10 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.752578:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4eec00, rc 0) 00000100:00100000:1.0:1789607831.752648:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:2376:x1876539520114560:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 294us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.752656:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:0.0:1789607831.760023:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607831.760182:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520114816 00000100:00100000:3.0:1789607831.760195:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520114816 00000100:00100000:3.0:1789607831.760277:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 123 00000100:00100000:3.0:1789607831.760291:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:10582:x1876539520114816:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789607831.760477:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:10582:x1876539520114816:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 188us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607831.760490:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 123 00000100:00100000:2.0:1789607831.763921:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.763999:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520114944 00000100:00100000:0.0:1789607831.764008:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520114944 00000100:00100000:0.0:1789607831.764108:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:0.0:1789607831.764117:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:10582:x1876539520114944:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607831.764132:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607831.764146:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b973f expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.764185:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a908035e/0x33f091d0013868c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9738 expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.764192:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607831.764196:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607831.764199:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b973f expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.764223:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a908035e/0x33f091d0013868c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9738 expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.764233:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a908035e/0x33f091d0013868c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9738 expref: 11 pid: 6695 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.764244:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c5272300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6694:1876539541100416:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607831.764492:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607831.779728:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.779882:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c5272300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6694:1876539541100416:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607831.779915:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b973f expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.779936:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103bc00, rc 0) 00000100:00100000:0.0:1789607831.780000:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:10582:x1876539520114944:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 15883us (16087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.780009:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:3.0:1789607831.780561:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520115072 00000100:00100000:3.0:1789607831.780570:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520115072 00010000:00010000:3.0:1789607831.780647:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a908035e/0x33f091d0013868c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9738 expref: 11 pid: 6695 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.780687:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:3.0:1789607831.780696:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:2374:x1876539520115072:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607831.780709:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607831.780732:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a908035e/0x33f091d0013868c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9738 expref: 11 pid: 6695 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.780747:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a908035e/0x33f091d0013868c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9738 expref: 11 pid: 6695 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.780770:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a908035e/0x33f091d0013868c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9738 expref: 11 pid: 6695 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.780845:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607831.780859:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607831.780867:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b973f expref: 10 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.780889:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b973f expref: 10 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.780923:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b973f expref: 10 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.780936:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5833:1876539541100544:192.168.202.3@tcp:105: 00000100:00100000:3.0:1789607831.781010:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15240 going to sleep for 11 seconds 00000100:00100000:1.0:1789607831.785932:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ae680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5833:1876539541100544:192.168.202.3@tcp:105: 00010000:00010000:1.0:1789607831.785962:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607831.786024:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:2374:x1876539520115072:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5328us (6306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.786035:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:1.0:1789607831.791594:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607831.791758:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520115200 00000100:00100000:2.0:1789607831.791770:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520115200 00002000:00100000:2.0:1789607831.791827:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99a1e4d6b100 x1876539520115200/t0(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:387/0 lens 504/0 e 0 to 0 dl 1789607842 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789607831.791838:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1e4d6b100 with x1876539520115200 ext(0->12) 00002000:00010000:2.0:1789607831.791844:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1e4d6b100 00000100:00100000:2.0:1789607831.791884:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:2.0:1789607831.791894:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:2373:x1876539520115200:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789607831.792356:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+12:2373:x1876539520115200:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 Request processed in 462us (773us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789607831.792365:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00002000:00100000:2.0:1789607831.792373:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99a1e4d6b100 x1876539520115200/t4294967308(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:387/0 lens 504/448 e 0 to 0 dl 1789607842 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789607831.792381:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1e4d6b100 with x1876539520115200 ext(0->12) 00002000:00010000:2.0:1789607831.792385:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1e4d6b100 00000100:00100000:2.0:1789607831.800661:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.800771:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520115328 00000100:00100000:0.0:1789607831.800781:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520115328 00000100:00100000:0.0:1789607831.800842:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 124 00000100:00100000:0.0:1789607831.800861:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:10582:x1876539520115328:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789607831.829042:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000020:00080000:0.0:1789607831.829094:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a1ffa6d900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789607831.829100:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1c9b01b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a1ffa6d840 00000020:00080000:0.0:1789607831.829104:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1c9b01d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a1ff415c00 00000001:00080000:0.0:1789607831.829117:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1789607831.829151:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789607831.829169:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a1c12ed480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789607831.829171:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1ee46f000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a1c3e68000 00000020:00080000:0.0:1789607831.829173:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1ee46f700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a1c3394c00 00000004:00080000:0.0:1789607831.829192:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:0.0:1789607831.829215:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789607831.829243:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789607831.829462:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789607831.829619:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c5272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541100672:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789607831.829686:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607831.829725:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607831.829732:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff9e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541100800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789607831.829755:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607831.829790:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541100672 00000100:00100000:0.0:1789607831.829798:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541100672 00000100:00100000:0.0:1789607831.829837:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541100800 00000100:00100000:0.0:1789607831.829841:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541100800 00000100:00100000:0.0:1789607831.829897:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789607831.829906:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876539541100672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789607831.829932:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1789607831.829967:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aab3f96, atime: 0x6aab3f96, ctime: 0x6aab3f96, blocks: 0x1 00010000:00010000:0.0:1789607831.829976:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017094693/0x33f091d0013868d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.829993:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1789607831.829998:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607831.830004:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017094693/0x33f091d0013868d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.830022:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017094693/0x33f091d0013868d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.830033:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017094693/0x33f091d0013868d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.830046:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017094693/0x33f091d0013868d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.830077:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789607831.830596:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1876539541100672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 690us (908us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789607831.830604:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789607831.830625:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789607831.830633:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876539541100800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789607831.830659:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1789607831.830675:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.830691:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d001386692 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b969e expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.830699:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789607831.830702:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607831.830706:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.830736:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d001386692 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b969e expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.830750:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d001386692 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b969e expref: 11 pid: 6694 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.830763:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876539541100928:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607831.830829:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da840 going to sleep for 11 seconds 00000004:00080000:0.0:1789607831.830883:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a1c5272300/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789607831.830890:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c5272300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541100672:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789607831.831139:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607831.831147:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017094693/0x33f091d0013868d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.831166:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a000 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607831.831170:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017094693/0x33f091d0013868d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.831180:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017094693/0x33f091d0013868d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.831198:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017094693/0x33f091d0013868d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.831206:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017094693/0x33f091d0013868d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.831227:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607831.831228:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607831.831230:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607831.832008:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:10582:x1876539520115328:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 Request processed in 31143us (31351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607831.832019:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 124 00000100:00100000:0.0:1789607831.838037:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1876539541100928:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607831.838084:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.841237:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607831.841353:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520115456 00000100:00100000:2.0:1789607831.841364:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520115456 00010000:00010000:2.0:1789607831.841419:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d001386692 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b969e expref: 12 pid: 6694 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607831.841502:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 56 00000100:00100000:2.0:1789607831.841513:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+12:2374:x1876539520115456:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607831.841529:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607831.841535:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d001386692 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b969e expref: 12 pid: 6694 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.841565:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d001386692 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b969e expref: 12 pid: 6694 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.841589:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d001386692 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b969e expref: 12 pid: 6694 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.841606:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607831.841611:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607831.841617:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.841627:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.841653:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607831.841715:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:2374:x1876539520115456:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 204us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607831.841723:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 56 00010000:00010000:0.0:1789607831.842315:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.842327:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.842338:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.842346:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.842406:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789607831.842998:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1876539541100800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12363us (13238us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789607831.843006:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789607831.843139:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.843195:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520115584 00000100:00100000:0.0:1789607831.843202:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520115584 00000004:00080000:3.0:1789607831.843318:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a1ff9e7b80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1789607831.843333:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff9e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541100800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789607831.844947:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:0.0:1789607831.844966:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:2374:x1876539520115584:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789607831.845917:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607831.845928:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.845941:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607831.845946:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.845957:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.845976:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.845984:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013868d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.848464:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607831.848471:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607831.848473:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789607831.883946:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789607831.883967:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1789607831.883978:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1789607831.884211:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2374:x1876539520115584:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 Request processed in 39247us (41066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607831.884223:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:3.0:1789607831.886655:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607831.887227:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520115840 00000100:00100000:1.0:1789607831.887238:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520115840 00000100:00100000:1.0:1789607831.887352:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 125 00000100:00100000:1.0:1789607831.887364:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:10582:x1876539520115840:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607831.887470:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607831.887500:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013868bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9731 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.887522:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1dab7db00) 00010000:00010000:1.0:1789607831.887528:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607831.887625:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013868de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.887640:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013868de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.887651:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013868de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607831.887959:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026f23a29 reply state 00000000b7e8b863 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013868de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607831.887968:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607831.888247:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:10582:x1876539520115840:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 884us (1602us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789607831.888257:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 125 00010000:00010000:3.0:1789607831.891281:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013868de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.891298:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013868de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.891307:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013868de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.891331:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607831.891337:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013868de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.891345:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013868de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.891362:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1dab7db00) 00010000:00010000:3.0:1789607831.891365:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607831.891370:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013868de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.891375:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d0013868de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.907297:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.908719:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520115968 00000100:00100000:0.0:1789607831.908748:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520115968 00000100:00100000:0.0:1789607831.908920:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:0.0:1789607831.908930:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2374:x1876539520115968:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789607831.909164:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789607831.909167:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789607831 00002000:00010000:0.0:1789607831.909169:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789607830 00002000:00010000:0.0:1789607831.909170:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789607831 -> 1789607831 00002000:00010000:0.0:1789607831.909172:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789607831.909227:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520115968:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 299us (2193us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789607831.909232:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:0.0:1789607831.913416:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607831.913606:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520116224 00000100:00100000:3.0:1789607831.913618:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520116224 00000100:00100000:3.0:1789607831.913675:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 126 00000100:00100000:3.0:1789607831.913684:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:10582:x1876539520116224:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789607831.913760:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.913778:0:11489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d00138689f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9723 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.913796:0:11489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.913862:0:11489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d00138689f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9723 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.913876:0:11489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d00138689f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9723 expref: 15 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.913891:0:11489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541101056:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607831.913988:0:11489:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c4f0f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607831.917410:0:11489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541101056:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607831.917472:0:11489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.919578:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607831.919792:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520116352 00000100:00100000:1.0:1789607831.919803:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520116352 00010000:00010000:1.0:1789607831.919843:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d00138689f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9723 expref: 16 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607831.919889:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:1.0:1789607831.919898:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:2373:x1876539520116352:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607831.919931:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607831.919949:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d00138689f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9723 expref: 16 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.919963:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d00138689f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9723 expref: 16 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.919994:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d00138689f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9723 expref: 16 pid: 5848 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.920013:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1dab7db00) 00010000:00010000:1.0:1789607831.920019:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.920027:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.920035:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607831.920073:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607831.920131:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:2373:x1876539520116352:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 233us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.920139:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 57 00010000:00010000:0.0:1789607831.920260:0:11489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.920269:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.920303:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.920309:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.920316:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.920322:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.920327:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.920342:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.920352:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1dab7db00) 00010000:00010000:0.0:1789607831.920355:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789607831.920358:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.920364:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013868e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.920406:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:10582:x1876539520116224:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 Request processed in 6722us (7000us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789607831.920414:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 126 00000100:00100000:2.0:1789607831.923378:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.923552:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520116480 00000100:00100000:0.0:1789607831.923562:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520116480 00000100:00100000:0.0:1789607831.923641:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:0.0:1789607831.923648:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2376:x1876539520116480:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789607831.923686:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.923701:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b973f expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.923707:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607831.923711:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607831.923715:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.923748:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b973f expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.923759:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b973f expref: 7 pid: 6694 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.923771:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff419880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8471:1876539541101184:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607831.923876:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8e1b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789607831.927335:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff419880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8471:1876539541101184:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607831.927370:0:8471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607831.928782:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.929142:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520116608 00000100:00100000:0.0:1789607831.929150:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520116608 00010000:00010000:0.0:1789607831.929190:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b973f expref: 8 pid: 6694 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.929234:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:0.0:1789607831.929243:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520116608:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607831.929258:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607831.929281:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b973f expref: 8 pid: 6694 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.929294:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b973f expref: 8 pid: 6694 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.929334:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013868c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b973f expref: 8 pid: 6694 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.929350:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607831.929354:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607831.929360:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.929369:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.929494:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607831.929546:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520116608:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 304us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.929555:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 58 00010000:00010000:2.0:1789607831.930915:0:8471:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.930950:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.930984:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.930994:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.931002:0:8471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.931009:0:8471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0030200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607831.931014:0:8471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.931023:0:8471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.931040:0:8471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.931111:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba8fafe3/0x33f091d0013868ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607831.931268:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520116480:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 Request processed in 7615us (7893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607831.931278:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:2.0:1789607831.934112:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607831.934158:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520116864 00000100:00100000:3.0:1789607831.934169:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520116864 00000100:00100000:3.0:1789607831.934227:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 127 00000100:00100000:3.0:1789607831.934237:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:10582:x1876539520116864:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789607831.934323:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013868f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.934340:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013868f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.934353:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013868f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.934647:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.934659:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013868ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b972a expref: 15 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.934667:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.934701:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013868ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b972a expref: 15 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.934714:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013868ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b972a expref: 15 pid: 11489 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607831.934727:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d15880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541101312:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607831.934806:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ffa6d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789607831.938804:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.939262:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d15880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541101312:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607831.939293:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607831.939349:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520116992 00000100:00100000:1.0:1789607831.939355:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520116992 00010000:00010000:1.0:1789607831.939384:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013868ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b972a expref: 16 pid: 11489 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.939455:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:3.0:1789607831.939467:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:2374:x1876539520116992:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607831.939489:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607831.939497:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013868ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b972a expref: 16 pid: 11489 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.939509:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013868ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b972a expref: 16 pid: 11489 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.939531:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013868ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b972a expref: 16 pid: 11489 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.939548:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1dab7db00) 00010000:00010000:3.0:1789607831.939552:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.939562:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.939569:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607831.939599:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607831.939636:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.939645:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607831.939710:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:2374:x1876539520116992:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 245us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607831.939717:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 59 00000001:00080000:0.0:1789607831.940739:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789607831.941157:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789607831.941207:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789607831.941278:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff419880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1876539541101440:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789607831.941338:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607831.941403:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607831.941606:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541101440 00000100:00100000:2.0:1789607831.941612:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541101440 00000100:00100000:2.0:1789607831.941691:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607831.941701:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876539541101440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789607831.941800:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1876539541101440:12345-0@lo:1000:mdt00_002.0 Request processed in 100us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607831.941808:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607831.941868:0:5849:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1789607831.941878:0:5849:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1789607831.941897:0:5849:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a1ff9e7b80, transno 4294967309 00000100:00100000:0.0:1789607831.941920:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff419880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1876539541101440:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789607831.943637:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789607831.943726:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff419880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1876539541101568:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789607831.943859:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607831.943896:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d4659f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789607831.943970:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541101568 00000100:00100000:1.0:1789607831.943976:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541101568 00000100:00100000:1.0:1789607831.944026:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789607831.944035:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1876539541101568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789607831.944356:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1876539541101568:12345-0@lo:1000:mdt00_002.0 Request processed in 322us (496us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789607831.944364:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607831.944481:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff419880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1876539541101568:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789607831.944520:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944649:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944658:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944665:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2c00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.944670:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944677:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944692:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1dab7db00) 00010000:00010000:0.0:1789607831.944703:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607831.944710:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944719:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d0013868fa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944750:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d00138683d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944755:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d00138683d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944760:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d00138683d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944764:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0031600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.944767:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d00138683d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944773:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d00138683d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944781:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:0.0:1789607831.944784:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607831.944801:0:5849:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386844 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b970e expref: 18 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944812:0:5849:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386844 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b970e expref: 18 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944820:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386844 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b970e expref: 18 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.944867:0:5849:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386844 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b970e expref: 18 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.944878:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff41bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541101696:192.168.202.3@tcp:105: 00000100:00100000:0.0:1789607831.944941:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8e1b480 going to sleep for 11 seconds 00010000:00010000:2.0:1789607831.947712:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607831.950353:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.950498:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff41bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541101696:192.168.202.3@tcp:105: 00010000:00010000:0.0:1789607831.950529:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d00138683d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950550:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d00138683d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950586:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386901 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950600:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386901 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950611:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386901 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950622:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386901 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950628:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386901 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950634:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386901 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950659:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0030200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.950663:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386901 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950670:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386901 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950682:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:0.0:1789607831.950685:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607831.950690:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386901 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950696:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386901 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950708:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013868f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950714:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013868f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950720:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013868f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950725:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607831.950728:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013868f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950734:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013868f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950754:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:0.0:1789607831.950757:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789607831.950760:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013868f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.950766:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d0013868f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607831.951035:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:10582:x1876539520116864:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 16797us (16928us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789607831.951057:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 127 00000020:00080000:0.0:1789607831.951064:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789607831.951354:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520117120 00000100:00100000:1.0:1789607831.951362:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520117120 00000100:00100000:1.0:1789607831.951404:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:1.0:1789607831.951414:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:10581:x1876539520117120:12345-192.168.202.3@tcp:49:lfs.0 00000100:00100000:1.0:1789607831.951526:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:10581:x1876539520117120:12345-192.168.202.3@tcp:49:lfs.0 Request processed in 114us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607831.951533:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 31 00000040:00080000:3.0:1789607831.951888:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607831.951893:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607831.952390:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789607831.952399:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789607831.960248:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607831.960494:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520117376 00000100:00100000:0.0:1789607831.960507:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520117376 00000100:00100000:0.0:1789607831.960589:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 128 00000100:00100000:0.0:1789607831.960602:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:10581:x1876539520117376:12345-192.168.202.3@tcp:58:lfs.0 00000100:00100000:1.0:1789607831.960612:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000040:00080000:0.0:1789607831.961006:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789607831.961100:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:10581:x1876539520117376:12345-192.168.202.3@tcp:58:lfs.0 Request processed in 499us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607831.961108:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 128 00000100:00100000:2.0:1789607831.961630:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520117632 00000100:00100000:2.0:1789607831.961636:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520117632 00000100:00100000:2.0:1789607831.961668:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:2.0:1789607831.961677:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1db76f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:10582:x1876539520117632:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789607831.962919:0:12083:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789607831.963038:0:12083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1789607831.963105:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386908 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.963119:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386908 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.963128:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386908 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.963386:0:12083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386908 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.963394:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386908 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.963400:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386908 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607831.963416:0:12083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607831.963785:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607831.963802:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386908 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.963810:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2e00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607831.963814:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386908 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.963834:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386908 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.963856:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a1db790600) 00010000:00010000:0.0:1789607831.963860:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789607831.963867:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386908 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.963873:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386908 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607831.963894:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607831.963896:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607831.963898:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607831.963939:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1db76f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:10582:x1876539520117632:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 2258us (3321us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789607831.963950:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 32 00000020:00080000:2.0:1789607831.963956:0:12083:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789607832.051742:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607832.051853:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520117760 00000100:00100000:0.0:1789607832.051863:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520117760 00000100:00080000:2.0:1789607832.051938:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607832.051962:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 129 00000100:00100000:0.0:1789607832.051976:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:10584:x1876539520117760:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607832.052006:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607832.052029:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d00138690f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9746 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.052094:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386916 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.052109:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.052122:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.052161:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138691d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.052169:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.052177:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.052412:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.052448:0:11489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9707 expref: 21 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.052458:0:11489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386924 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.052494:0:11489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9707 expref: 21 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.052509:0:11489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9707 expref: 21 pid: 11489 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607832.052526:0:11489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff41bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541101824:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607832.052645:0:11489:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8e1b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789607832.055483:0:11489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff41bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541101824:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607832.055514:0:11489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607832.056813:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607832.056909:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520118016 00000100:00100000:2.0:1789607832.056917:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520118016 00000100:00100000:2.0:1789607832.056968:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:2.0:1789607832.056983:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:5614:x1876539520118016:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789607832.057220:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:5614:x1876539520118016:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 243us (412us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789607832.057225:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:2.0:1789607832.065333:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607832.065476:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520118144 00000100:00100000:0.0:1789607832.065487:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520118144 00010000:00010000:0.0:1789607832.065603:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9707 expref: 23 pid: 11489 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607832.065640:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:0.0:1789607832.065651:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:2376:x1876539520118144:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607832.065765:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607832.065774:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9707 expref: 23 pid: 11489 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.065858:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9707 expref: 23 pid: 11489 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.065881:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d00138682f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9707 expref: 23 pid: 11489 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.065898:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:0.0:1789607832.065902:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.065912:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.065920:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386924 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607832.065992:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607832.066063:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c73450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:2376:x1876539520118144:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 413us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607832.066071:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 60 00010000:00010000:3.0:1789607832.072873:0:11489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607832.072910:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607832.073026:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789607832.073033:0:11489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607832.073068:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073086:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073097:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386916 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073103:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386916 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073111:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386916 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073117:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0031600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607832.073129:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386916 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073138:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386916 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073153:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:2.0:1789607832.073156:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607832.073161:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386916 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073167:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386916 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073183:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073189:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138691d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073194:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138691d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073200:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0030a00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607832.073202:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138691d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073208:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138691d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073215:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a1f911df00) 00010000:00010000:2.0:1789607832.073218:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607832.073228:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138691d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073234:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138691d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073962:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d00138690f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9746 expref: 22 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073982:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9746 expref: 21 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607832.073990:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:2.0:1789607832.073992:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607832.073995:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c0031000, rc 0) 00000100:00100000:2.0:1789607832.074079:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:10584:x1876539520117760:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 22106us (22347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607832.074088:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 129 00000040:00080000:3.0:1789607832.918191:0:12121:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607832.918201:0:12121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607832.918250:0:12121:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789607832.918255:0:12121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789607832.976212:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607832.976222:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607832.976279:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789607832.976288:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789607832.976440:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1d0d13100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1876539541101952:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789607832.976532:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c4f0fe40 going to sleep for 11 seconds 00010000:00010000:3.0:1789607832.978665:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607832.983520:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1d0d13100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1876539541101952:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789607832.997335:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607832.997613:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520118272 00000100:00100000:0.0:1789607832.997625:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520118272 00000100:00100000:0.0:1789607832.997691:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 130 00000100:00100000:0.0:1789607832.997701:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:10595:x1876539520118272:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789607832.997737:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789607832.998094:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:10595:x1876539520118272:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 392us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607832.998103:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 130 00000100:00100000:0.0:1789607833.005927:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607833.007968:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520118528 00000100:00100000:3.0:1789607833.007992:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520118528 00000100:00100000:3.0:1789607833.008063:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 131 00000100:00100000:3.0:1789607833.008073:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:10595:x1876539520118528:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607833.008094:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607833.008116:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138692b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b974d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.008416:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386932 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.008462:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.008474:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607833.008485:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789607833.008625:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d00138692b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b974d expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.008660:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b974d expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.008668:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:3.0:1789607833.008671:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607833.008675:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558fe00, rc 0) 00000100:00100000:3.0:1789607833.008749:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:10595:x1876539520118528:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 677us (2831us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789607833.008757:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 131 00000100:00100000:2.0:1789607833.014598:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607833.015408:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520118784 00000100:00100000:3.0:1789607833.015419:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520118784 00000100:00100000:3.0:1789607833.015495:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 132 00000100:00100000:3.0:1789607833.015505:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:10595:x1876539520118784:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789607833.015590:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d001386940 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.015607:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d001386940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.015620:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d001386940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.015866:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d001386940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.015874:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d001386940 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.015891:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d001386940 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.015897:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558e800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607833.015902:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d001386940 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.015909:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d001386940 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.015921:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:3.0:1789607833.015924:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789607833.015931:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d001386940 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.015937:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e800/0x33f091d001386940 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607833.016641:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:10595:x1876539520118784:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 1132us (2048us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1789607833.016651:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 132 00000040:00080000:3.0:1789607833.016763:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607833.016767:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607833.017515:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789607833.017534:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789607833.018370:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607833.018624:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520118912 00000100:00100000:3.0:1789607833.018634:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520118912 00000100:00100000:3.0:1789607833.018730:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:3.0:1789607833.018740:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:2373:x1876539520118912:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607833.018761:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607833.018797:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386932 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b974d expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607833.018817:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:3.0:1789607833.018823:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607833.018880:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:2373:x1876539520118912:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 142us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607833.018887:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:2.0:1789607833.021631:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607833.021719:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520119168 00000100:00100000:3.0:1789607833.021728:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520119168 00000100:00100000:3.0:1789607833.021879:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:3.0:1789607833.021890:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:10595:x1876539520119168:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789607833.022165:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:10595:x1876539520119168:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 276us (541us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789607833.022174:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:0.0:1789607833.227947:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607833.227972:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541102080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607833.228106:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607833.228228:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541102080 00000100:00100000:3.0:1789607833.228236:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541102080 00000100:00100000:3.0:1789607833.228296:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789607833.228306:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876539541102080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607833.228340:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607833.228388:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876539541102080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607833.228395:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789607833.228489:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541102080:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789607833.228931:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789607833.996045:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789607834.877147:0:12172:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789607834.877156:0:12172:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789607834.877204:0:12172:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789607834.877210:0:12172:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789607835.020924:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607835.024175:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607835.024261:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520119424 00000100:00100000:2.0:1789607835.024274:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520119424 00000100:00100000:2.0:1789607835.024351:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 133 00000100:00100000:2.0:1789607835.024362:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:10616:x1876539520119424:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607835.024386:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607835.024407:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386947 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9754 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.024556:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138694e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.024570:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138694e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.024583:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138694e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607835.024595:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789607835.024720:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386947 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9754 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.024739:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138694e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9754 expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.024746:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:2.0:1789607835.024749:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789607835.024753:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3600, rc 0) 00000100:00100000:2.0:1789607835.024837:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:10616:x1876539520119424:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 477us (670us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789607835.024844:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 133 00000100:00080000:3.0:1789607835.025008:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607835.028363:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607835.028463:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520119552 00000100:00100000:2.0:1789607835.028475:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520119552 00000100:00100000:2.0:1789607835.028531:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 134 00000100:00100000:2.0:1789607835.028543:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:10616:x1876539520119552:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:2.0:1789607835.028611:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d00138695c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.028641:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d00138695c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.028654:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d00138695c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.028684:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d00138695c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.028690:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d00138695c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.028697:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d00138695c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.028703:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607835.028707:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d00138695c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.028714:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d00138695c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.028724:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:2.0:1789607835.028727:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607835.028731:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d00138695c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607835.028737:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d00138695c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607835.028794:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:10616:x1876539520119552:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 254us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607835.028807:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 134 00000100:00100000:2.0:1789607835.134979:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607835.135133:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520119680 00000100:00100000:3.0:1789607835.135143:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520119680 00000100:00100000:3.0:1789607835.135226:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:3.0:1789607835.135238:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2375:x1876539520119680:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1789607835.135255:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607835.135276:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c42f243b/0x33f091d001386963 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b975b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789607835.135305:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aab3f97, atime: 0x6aab3f96, ctime: 0x6aab3f97, blocks: 0xb 00010000:00010000:3.0:1789607835.135326:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=368s v=(0 0) 00010000:00010000:3.0:1789607835.135331:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607835.135341:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c42f243b/0x33f091d001386963 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b975b expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607835.135362:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c42f243b/0x33f091d001386963 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b975b expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607835.135376:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e800, rc 0) 00000100:00100000:3.0:1789607835.135472:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2375:x1876539520119680:12345-192.168.202.3@tcp:101:cat.0 Request processed in 236us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607835.135480:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00080000:2.0:1789607835.135831:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607835.139357:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607835.140651:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520119808 00000100:00100000:3.0:1789607835.140667:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520119808 00002000:00100000:3.0:1789607835.140724:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff99a1d0d12a00 x1876539520119808/t0(0) o3->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:391/0 lens 488/0 e 0 to 0 dl 1789607846 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789607835.140735:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1d0d12a00 with x1876539520119808 ext(0->4095) 00002000:00010000:3.0:1789607835.140895:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1d0d12a00 00000100:00100000:3.0:1789607835.141004:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:3.0:1789607835.141015:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2376:x1876539520119808:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1789607835.141234:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2376:x1876539520119808:12345-192.168.202.3@tcp:3:cat.0 Request processed in 219us (1887us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789607835.141241:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00002000:00100000:3.0:1789607835.141247:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff99a1d0d12a00 x1876539520119808/t0(0) o3->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:391/0 lens 488/4536 e 0 to 0 dl 1789607846 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789607835.141255:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1d0d12a00 with x1876539520119808 ext(0->4095) 00002000:00010000:3.0:1789607835.141258:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1d0d12a00 00000100:00100000:1.0:1789607835.451687:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607835.451835:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607835.451872:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607835.451899:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607835.451925:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607835.451957:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520120192 00000100:00100000:1.0:1789607835.451966:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520120192 00000100:00100000:1.0:1789607835.452030:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520120320 00000100:00100000:1.0:1789607835.452034:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520120320 00000100:00100000:1.0:1789607835.452059:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:1.0:1789607835.452068:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2375:x1876539520120192:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607835.452131:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2375:x1876539520120192:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 65us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607835.452139:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:1.0:1789607835.452156:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:1.0:1789607835.452162:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2375:x1876539520120320:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607835.452183:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2375:x1876539520120320:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 22us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607835.452189:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00080000:1.0:1789607835.452206:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607835.452325:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520120448 00000100:00100000:1.0:1789607835.452330:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520120448 00000100:00100000:1.0:1789607835.452358:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520120064 00000100:00100000:1.0:1789607835.452361:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520120064 00000100:00100000:1.0:1789607835.452377:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 146 00000100:00100000:1.0:1789607835.452399:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2375:x1876539520120448:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607835.452453:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2375:x1876539520120448:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 55us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607835.452459:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 146 00000100:00100000:1.0:1789607835.452471:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 147 00000100:00100000:1.0:1789607835.452476:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:2375:x1876539520120064:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607835.452514:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:2375:x1876539520120064:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 37us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607835.452520:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 147 00000100:00080000:1.0:1789607835.452537:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607835.461456:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520119936 00000100:00100000:2.0:1789607835.461471:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520119936 00000100:00100000:2.0:1789607835.461593:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 292 00000100:00100000:2.0:1789607835.461604:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2375:x1876539520119936:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607835.461687:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2375:x1876539520119936:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 85us (10011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607835.461695:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 292 00000001:00080000:1.0:1789607835.841277:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1789607835.841314:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:0.0:1789607836.043698:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607836.300726:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541102336:0@lo:400:kworker.0 00000100:00100000:0.0:1789607836.300831:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607836.300965:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541102592:0@lo:400:kworker.0 00000100:00100000:0.0:1789607836.301093:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541102848:0@lo:400:kworker.0 00000100:00100000:0.0:1789607836.301138:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876539541102464:0@lo:400:kworker.0 00000100:00100000:0.0:1789607836.301166:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607836.301223:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541102336 00000100:00100000:0.0:1789607836.301232:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541102336 00000100:00100000:0.0:1789607836.301285:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541102464 00000100:00100000:0.0:1789607836.301288:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541102464 00000100:00100000:2.0:1789607836.301389:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607836.301444:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789607836.301452:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541102208:0@lo:400:kworker.0 00000100:00100000:2.0:1789607836.301489:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607836.301511:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c5270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876539541102720:0@lo:400:kworker.0 00000100:00100000:2.0:1789607836.301533:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607836.301634:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541102720 00000100:00100000:1.0:1789607836.301639:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541102720 00000100:00100000:1.0:1789607836.301669:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789607836.301679:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541102336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607836.301747:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541102336:12345-0@lo:400:kworker.0 Request processed in 69us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607836.301755:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789607836.301776:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789607836.301782:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876539541102464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607836.301836:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876539541102464:12345-0@lo:400:kworker.0 Request processed in 53us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607836.301841:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789607836.301856:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789607836.301945:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876539541102720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607836.301988:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876539541102720:12345-0@lo:400:kworker.0 Request processed in 117us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607836.301994:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1789607836.302177:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607836.302197:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541102592 00000100:00100000:1.0:1789607836.302202:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541102592 00000100:00100000:1.0:1789607836.302241:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789607836.302247:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541102592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607836.302282:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541102592:12345-0@lo:400:kworker.0 Request processed in 36us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607836.302288:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789607836.302309:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541102208 00000100:00100000:1.0:1789607836.302312:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541102208 00000100:00100000:0.0:1789607836.303570:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607836.303654:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff41aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541102336:0@lo:400:kworker.0 00000100:00100000:0.0:1789607836.303689:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541102848 00000100:00100000:0.0:1789607836.303695:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541102848 00000100:00100000:0.0:1789607836.303740:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789607836.303749:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1876539541102848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607836.303823:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1876539541102848:12345-0@lo:400:kworker.0 Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607836.303830:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789607836.303864:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541102848:0@lo:400:kworker.0 00000100:00100000:1.0:1789607836.304165:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789607836.304173:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3311:x1876539541102208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607836.304217:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3311:x1876539541102208:12345-0@lo:400:kworker.0 Request processed in 45us (2727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607836.304223:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1789607836.304268:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789607836.304273:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607836.304294:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541102208:0@lo:400:kworker.0 00000100:00100000:1.0:1789607836.304310:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c5270a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876539541102720:0@lo:400:kworker.0 00000100:00100000:2.0:1789607836.304499:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876539541102464:0@lo:400:kworker.0 00000100:00100000:1.0:1789607836.304592:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789607836.304599:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1789607836.304618:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a1c5272300, transno 4294967304 00000100:00100000:1.0:1789607836.304687:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541102592:0@lo:400:kworker.0 00000100:00100000:1.0:1789607836.824171:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541102976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607836.824275:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789607836.825010:0:7982:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370669584996ns, next at 371669581876ns, rc = 0 00000100:00100000:0.0:1789607836.827153:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541102976 00000100:00100000:0.0:1789607836.827177:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541102976 00000100:00100000:0.0:1789607836.827251:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789607836.827264:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876539541102976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607836.827318:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607836.829859:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876539541102976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2582us (5568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607836.829891:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789607836.837669:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541102976:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789607836.917253:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:0.0:1789607836.917278:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a1d20da840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789607836.917293:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1c989af00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a1ff9a1b40 00000020:00080000:0.0:1789607836.917299:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1c989a900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a1ff32a000 00000020:00080000:0.0:1789607836.917338:0:5869:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:0.0:1789607836.917360:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1789607836.917681:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789607836.918315:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1789607837.067629:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789607837.390580:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1789607837.390623:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:1.0:1789607838.092900:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789607838.156689:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607838.156704:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607838.156754:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789607838.156761:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789607838.347841:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541103104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607838.347915:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607838.349090:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541103104 00000100:00100000:0.0:1789607838.349103:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541103104 00000100:00100000:0.0:1789607838.349197:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789607838.349208:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541103104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607838.349252:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607838.349309:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541103104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607838.349316:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1789607838.349846:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607838.349902:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541103104:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789607839.115695:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607840.139735:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607840.240547:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607840.241093:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520120576 00000100:00100000:2.0:1789607840.241104:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520120576 00000100:00100000:2.0:1789607840.242077:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 135 00000100:00100000:2.0:1789607840.242091:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:10261:x1876539520120576:12345-192.168.202.3@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789607840.242207:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:10261:x1876539520120576:12345-192.168.202.3@tcp:60:lhsmtool_posix.0 Request processed in 120us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607840.242233:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 135 00000100:00080000:1.0:1789607840.242626:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607840.252049:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607840.252206:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520120832 00000100:00100000:2.0:1789607840.252217:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520120832 00000100:00100000:2.0:1789607840.252283:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:2.0:1789607840.252293:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:10261:x1876539520120832:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789607840.252659:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:10261:x1876539520120832:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 365us (618us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789607840.252667:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:0.0:1789607840.562092:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607840.562207:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607840.562244:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607840.562293:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607840.562484:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520121216 00000100:00100000:1.0:1789607840.562498:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520121216 00000100:00100000:1.0:1789607840.562581:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520121088 00000100:00100000:1.0:1789607840.562585:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520121088 00000100:00100000:1.0:1789607840.562612:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:1.0:1789607840.562624:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520121216:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607840.562736:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2376:x1876539520121216:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 113us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607840.562744:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:1.0:1789607840.562773:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:1.0:1789607840.562780:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520121088:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607840.562829:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2376:x1876539520121088:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 50us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607840.562836:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:3.0:1789607840.564280:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520121344 00000100:00100000:3.0:1789607840.564298:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520121344 00000100:00100000:3.0:1789607840.564384:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 151 00000100:00100000:3.0:1789607840.564394:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2376:x1876539520121344:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607840.564518:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2376:x1876539520121344:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 126us (2224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607840.564526:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 151 00000100:00080000:0.0:1789607840.564901:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607840.564909:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607840.564912:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607840.570880:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520120960 00000100:00100000:2.0:1789607840.570903:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520120960 00000100:00100000:2.0:1789607840.571126:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 294 00000100:00100000:2.0:1789607840.571137:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2376:x1876539520120960:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607840.571238:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2376:x1876539520120960:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 103us (9164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607840.571244:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 294 00010000:00010000:3.0:1789607841.163728:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607841.432487:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876539541103488:0@lo:400:kworker.0 00000100:00100000:2.0:1789607841.432586:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607841.432661:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789607841.432668:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541103360:0@lo:400:kworker.0 00000100:00100000:2.0:1789607841.432694:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607841.432711:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541103872:0@lo:400:kworker.0 00000100:00100000:2.0:1789607841.432739:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607841.432811:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541103872 00000100:00100000:2.0:1789607841.432822:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541103872 00000100:00100000:2.0:1789607841.432975:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789607841.432986:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541103872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607841.433047:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541103872:12345-0@lo:400:kworker.0 Request processed in 64us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607841.433055:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789607841.433104:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789607841.433111:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1789607841.433145:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541103872:0@lo:400:kworker.0 00000100:00100000:3.0:1789607841.434002:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541103488 00000100:00100000:3.0:1789607841.434014:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541103488 00000100:00100000:3.0:1789607841.434165:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541103360 00000100:00100000:3.0:1789607841.434169:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541103360 00000100:00100000:3.0:1789607841.434195:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789607841.434206:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876539541103488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607841.434298:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541103616:0@lo:400:kworker.0 00000100:00100000:3.0:1789607841.434299:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876539541103488:12345-0@lo:400:kworker.0 Request processed in 92us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607841.434312:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789607841.434335:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789607841.434343:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541103360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607841.434355:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607841.434408:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789607841.434416:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541103232:0@lo:400:kworker.0 00000100:00100000:0.0:1789607841.434484:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607841.434510:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876539541103744:0@lo:400:kworker.0 00000100:00100000:0.0:1789607841.434536:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607841.434585:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541103744 00000100:00100000:0.0:1789607841.434590:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541103744 00000100:00100000:0.0:1789607841.434619:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789607841.434626:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876539541103744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607841.434649:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541103360:12345-0@lo:400:kworker.0 Request processed in 306us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607841.434657:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789607841.434685:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee933480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1876539541103744:12345-0@lo:400:kworker.0 Request processed in 58us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607841.434693:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789607841.434720:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541103616 00000100:00100000:3.0:1789607841.434723:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541103360:0@lo:400:kworker.0 00000100:00100000:0.0:1789607841.434725:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541103616 00000100:00100000:3.0:1789607841.434743:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876539541103488:0@lo:400:kworker.0 00000100:00100000:0.0:1789607841.434775:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789607841.434785:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541103616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607841.434819:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541103616:12345-0@lo:400:kworker.0 Request processed in 37us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607841.434825:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789607841.434843:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541103232 00000100:00100000:3.0:1789607841.434848:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541103232 00000100:00100000:3.0:1789607841.434876:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789607841.434883:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3311:x1876539541103232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607841.434914:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3311:x1876539541103232:12345-0@lo:400:kworker.0 Request processed in 33us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607841.434934:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00080000:3.0:1789607841.434965:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789607841.434971:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789607841.434982:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607841.434993:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541103232:0@lo:400:kworker.0 00000100:00100000:0.0:1789607841.435006:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1876539541103744:0@lo:400:kworker.0 00000100:00100000:0.0:1789607841.435015:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541103616:0@lo:400:kworker.0 00000004:00080000:3.0:1789607841.934811:0:7982:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 375779383317ns, next at 376779380395ns, rc = 0 00000100:00100000:3.0:1789607841.934840:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607841.934870:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541104000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607841.935068:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607841.938948:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541104000 00000100:00100000:0.0:1789607841.938973:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541104000 00000100:00100000:0.0:1789607841.939065:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789607841.939078:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541104000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607841.939590:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607841.939770:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541104000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 693us (4794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607841.939779:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789607841.943026:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541104000:0@lo:13:osp-pre-1-0.0 00000020:00080000:1.0:1789607842.001339:0:5869:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1789607842.001393:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000004:00080000:1.0:1789607842.001407:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789607842.001603:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789607842.001625:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1789607842.001891:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607842.001963:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541104128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789607842.002125:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607842.002327:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541104128 00000100:00100000:2.0:1789607842.002340:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541104128 00000100:00100000:2.0:1789607842.002571:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789607842.002594:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541104128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789607842.002970:0:8471:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789607842.002988:0:8471:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789607831 -> 1789607831 00002000:00010000:2.0:1789607842.002991:0:8471:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789607830 -> 1789607830 00002000:00010000:2.0:1789607842.002994:0:8471:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789607831 -> 1789607831 00002000:00010000:2.0:1789607842.002996:0:8471:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789607842.003072:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5272300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541104128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 491us (946us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789607842.003080:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:0.0:1789607842.003146:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a1e4d16300/2, rc 0, transno 4294967312 00000100:00100000:0.0:1789607842.003155:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541104128:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789607842.193309:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789607842.236165:0:12375:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 21:17:20 (1789607840) 00000001:00080000:0.0:1789607842.500544:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1789607843.211856:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607843.469881:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541104256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607843.469989:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607843.470140:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541104256 00000100:00100000:3.0:1789607843.470152:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541104256 00000100:00100000:3.0:1789607843.470252:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789607843.470264:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541104256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607843.470317:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607843.470390:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5270a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541104256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607843.470398:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789607843.470521:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541104256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607843.470604:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607843.546011:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607843.546123:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520121600 00000100:00100000:3.0:1789607843.546143:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520121600 00000100:00100000:3.0:1789607843.546260:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 136 00000100:00100000:3.0:1789607843.546276:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:11327:x1876539520121600:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607843.546309:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607843.546339:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138696a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9762 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.546504:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386971 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.546522:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386971 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.546561:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386971 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.546582:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386978 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.546590:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386978 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.546597:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386978 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.546978:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138697f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547194:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138697f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547203:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138697f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607843.547218:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789607843.547460:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386971 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547470:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386971 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547478:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386971 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547484:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fe00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607843.547499:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386971 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547508:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386971 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547523:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99a1dab7d000) 00010000:00010000:3.0:1789607843.547526:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607843.547532:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386971 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547539:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d001386971 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547554:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386978 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547562:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386978 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547568:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386978 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547573:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558ee00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607843.547577:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386978 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547583:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386978 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547590:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99a1c3982600) 00010000:00010000:3.0:1789607843.547592:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607843.547602:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386978 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.547607:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386978 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789607843.548835:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789607843.549195:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138696a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9762 expref: 16 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.549225:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138697f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9762 expref: 15 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607843.549233:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1f911d000) 00010000:00010000:3.0:1789607843.549236:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607843.549240:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f800, rc 0) 00000100:00100000:3.0:1789607843.549384:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:11327:x1876539520121600:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 3112us (3383us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789607843.549394:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 136 00000100:00100000:0.0:1789607843.556355:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607843.556650:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520121728 00000100:00100000:2.0:1789607843.556664:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520121728 00000100:00100000:2.0:1789607843.556760:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1789607843.556772:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee933100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:2376:x1876539520121728:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607843.556812:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607843.556846:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d00138697f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9762 expref: 15 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607843.556870:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1f911d000) 00010000:00010000:2.0:1789607843.556877:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607843.557015:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee933100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:2376:x1876539520121728:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 244us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607843.557023:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:1.0:1789607843.558508:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607843.559194:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520121856 00000100:00100000:3.0:1789607843.559208:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520121856 00000100:00100000:3.0:1789607843.559313:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 137 00000100:00100000:3.0:1789607843.559324:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:11327:x1876539520121856:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789607843.559486:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:11327:x1876539520121856:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 Request processed in 164us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607843.559494:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 137 00010000:00010000:0.0:1789607844.236099:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789607844.306068:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607844.306082:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607844.306842:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789607844.306857:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789607845.259703:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607845.681281:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607845.681336:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607845.681392:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607845.681451:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607845.681488:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607845.681536:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520122496 00000100:00100000:2.0:1789607845.681550:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520122496 00000100:00100000:2.0:1789607845.681628:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520122112 00000100:00100000:2.0:1789607845.681632:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520122112 00000100:00100000:2.0:1789607845.681662:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 155 00000100:00100000:2.0:1789607845.681675:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520122496:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607845.681784:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2373:x1876539520122496:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 111us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607845.681793:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 155 00000100:00100000:2.0:1789607845.681814:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 156 00000100:00100000:2.0:1789607845.681820:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:2373:x1876539520122112:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607845.681848:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:2373:x1876539520122112:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607845.682019:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 156 00000100:00100000:3.0:1789607845.682472:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520121984 00000100:00100000:3.0:1789607845.682480:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520121984 00000100:00100000:3.0:1789607845.682592:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 296 00000100:00100000:3.0:1789607845.682602:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520121984:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607845.682660:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520121984:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 60us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607845.682667:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 296 00000100:00100000:0.0:1789607845.683006:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520122240 00000100:00100000:0.0:1789607845.683013:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520122240 00000100:00100000:0.0:1789607845.683051:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520122368 00000100:00100000:0.0:1789607845.683054:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520122368 00000100:00100000:0.0:1789607845.683081:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 88 00000100:00100000:0.0:1789607845.683089:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2373:x1876539520122240:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607845.683123:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2373:x1876539520122240:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 36us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607845.683129:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 88 00000100:00100000:0.0:1789607845.683143:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 89 00000100:00100000:0.0:1789607845.683150:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520122368:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607845.683174:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520122368:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 25us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607845.683180:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 89 00000100:00080000:0.0:1789607845.683202:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607845.683207:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607845.683209:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789607846.287371:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607846.300853:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607846.300981:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520122624 00000100:00100000:3.0:1789607846.300995:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520122624 00000100:00100000:3.0:1789607846.301074:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 138 00000100:00100000:3.0:1789607846.301087:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:11370:x1876539520122624:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607846.301114:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607846.301144:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138698d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9769 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301233:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386994 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301251:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386994 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301266:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386994 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301284:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d00138699b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301292:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d00138699b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301299:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d00138699b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301644:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386994 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301664:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386994 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301672:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386994 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301679:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558ee00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607846.301685:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386994 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301695:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386994 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301720:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1db790800) 00010000:00010000:3.0:1789607846.301725:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607846.301732:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386994 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301739:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386994 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301753:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d00138699b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301759:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d00138699b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301766:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d00138699b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301777:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fe00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607846.301781:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d00138699b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301787:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d00138699b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301796:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99a1c3982600) 00010000:00010000:3.0:1789607846.301799:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607846.301802:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d00138699b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301808:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d00138699b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301851:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138698d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9769 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301863:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1db790800) 00010000:00010000:3.0:1789607846.301866:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607846.301869:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d00138698d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9769 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.301879:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f000, rc 0) 00000100:00100000:3.0:1789607846.301969:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:11370:x1876539520122624:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 884us (1131us total) trans 0 rc 301/301 00000100:00100000:3.0:1789607846.301978:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 138 00000100:00100000:2.0:1789607846.308337:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607846.308471:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520122880 00000100:00100000:3.0:1789607846.308494:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520122880 00000100:00100000:3.0:1789607846.308561:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 139 00000100:00100000:3.0:1789607846.308573:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:11370:x1876539520122880:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1789607846.308646:0:11489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607846.308691:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d001386319 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95a9 expref: 14 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.308724:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1db790800) 00010000:00010000:3.0:1789607846.308737:0:11489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607846.309011:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869a2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.309028:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.309041:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.309056:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869a9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.309063:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.309070:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607846.310210:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789607846.310231:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869a2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.310241:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869a2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.310258:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.310266:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607846.310271:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869a2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.310281:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869a2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.310296:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607846.310300:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607846.310305:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869a2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.310312:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869a2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607846.310335:0:11489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9959613 reply state 00000000759aef4c transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607846.310347:0:11489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607846.310527:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:11370:x1876539520122880:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 1951us (2199us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789607846.310537:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 139 00010000:00010000:3.0:1789607846.315913:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869a9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.315932:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869a9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.315960:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.315967:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558e000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607846.315972:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869a9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.315992:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869a9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.316013:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99a1c3982e00) 00010000:00010000:3.0:1789607846.316016:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607846.316023:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869a9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.316030:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869a9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607846.423048:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607846.424182:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520123008 00000100:00100000:1.0:1789607846.424196:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520123008 00000100:00100000:1.0:1789607846.424797:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 140 00000100:00100000:1.0:1789607846.424810:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+14:11378:x1876539520123008:12345-192.168.202.3@tcp:101:lctl.0 00010000:00010000:1.0:1789607846.424835:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607846.424860:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d0013869b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9770 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.424928:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013869b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.424955:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013869b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.424969:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013869b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607846.425006:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789607846.425010:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607846.425030:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013869b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.425057:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef000/0x33f091d0013869b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9770 expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.425074:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013869b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9770 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.425083:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7dd00) 00010000:00010000:1.0:1789607846.425086:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607846.425090:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4efa00, rc 0) 00000100:00100000:1.0:1789607846.425165:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:11378:x1876539520123008:12345-192.168.202.3@tcp:101:lctl.0 Request processed in 357us (2125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607846.425172:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 140 00000100:00100000:2.0:1789607846.487194:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607846.487312:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520123136 00000100:00100000:3.0:1789607846.487330:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520123136 00000100:00100000:3.0:1789607846.487473:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 141 00000100:00100000:3.0:1789607846.487482:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+15:11384:x1876539520123136:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1789607846.487509:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607846.487920:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9777 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488021:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488055:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488068:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488082:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013869cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488086:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013869cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488091:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013869cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488198:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013869d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488202:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013869d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488207:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013869d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607846.488236:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789607846.488239:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607846.488258:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013869d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488269:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488282:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488287:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488291:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607846.488295:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488302:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488313:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7dd00) 00010000:00010000:3.0:1789607846.488315:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607846.488320:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488324:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d0013869c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488336:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013869cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488340:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013869cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488344:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013869cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488346:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607846.488352:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013869cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488356:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013869cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488360:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99a1c3982e00) 00010000:00010000:3.0:1789607846.488361:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607846.488363:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013869cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488366:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d0013869cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.488967:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d0013869be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9777 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.489036:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013869d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9777 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.489045:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607846.489047:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789607846.489050:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558fe00, rc 0) 00000100:00100000:3.0:1789607846.489221:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:11384:x1876539520123136:12345-192.168.202.3@tcp:101:bash.0 Request processed in 1737us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607846.489231:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 141 00000100:00100000:0.0:1789607846.494958:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607846.495064:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520123392 00000100:00100000:2.0:1789607846.495080:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520123392 00000100:00100000:2.0:1789607846.495162:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 142 00000100:00100000:2.0:1789607846.495175:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+16:11384:x1876539520123392:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607846.495205:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607846.495233:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d0013869da lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b977e expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.495404:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d0013869e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.495447:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d0013869e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.495462:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d0013869e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.495642:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d0013869e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.495676:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d0013869e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.495691:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d0013869e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789607846.496351:0:6790:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789607846.496624:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013869ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.496637:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013869ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.496646:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013869ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.496685:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d0013869e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.496693:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d0013869e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.496700:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d0013869e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.496715:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607846.496721:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d0013869e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.496730:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d0013869e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.496741:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:2.0:1789607846.496744:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607846.496749:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d0013869e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.496768:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d0013869e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607846.496783:0:6790:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047206ea1 reply state 000000009c32a443 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d0013869e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607846.496792:0:6790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789607846.496827:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d0013869da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b977e expref: 19 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.496842:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013869ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b977e expref: 18 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.496850:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:2.0:1789607846.496852:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607846.496855:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e2600, rc 0) 00000100:00100000:2.0:1789607846.496934:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:11384:x1876539520123392:12345-192.168.202.3@tcp:101:bash.0 Request processed in 1761us (1992us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789607846.496942:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 142 00000100:00100000:0.0:1789607846.500596:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1789607846.500853:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d0013869e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.500869:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d0013869e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.500898:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d0013869e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.500905:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3e00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607846.500911:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d0013869e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.500918:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d0013869e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.500935:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1db790d00) 00010000:00010000:3.0:1789607846.500937:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607846.500943:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d0013869e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.500947:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3e00/0x33f091d0013869e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607846.501245:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520123520 00000100:00100000:1.0:1789607846.501257:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520123520 00000100:00100000:1.0:1789607846.501316:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:1.0:1789607846.501324:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2374:x1876539520123520:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:1.0:1789607846.501345:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607846.501372:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d0013869fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9785 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607846.501408:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607846.501446:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1789607846.501451:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607846.501460:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d0013869fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9785 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.501476:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d0013869fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9785 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.501486:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef000, rc 0) 00000100:00100000:1.0:1789607846.501549:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2374:x1876539520123520:12345-192.168.202.3@tcp:101:bash.0 Request processed in 227us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607846.501555:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:0.0:1789607846.507581:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607846.507723:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520123648 00000100:00100000:2.0:1789607846.507741:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520123648 00000100:00100000:2.0:1789607846.507826:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:2.0:1789607846.508016:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:11384:x1876539520123648:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607846.508037:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607846.508056:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b978c expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.508114:0:8471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d0013869fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9785 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.508124:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607846.508128:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607846.508133:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 7 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.508171:0:8471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d0013869fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9785 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.508185:0:8471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d0013869fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9785 expref: 7 pid: 6694 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607846.508217:0:8471:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8471:1876539541104384:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607846.508325:0:8471:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8e1b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607846.515117:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607846.515289:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520123776 00000100:00100000:1.0:1789607846.515302:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520123776 00010000:00010000:1.0:1789607846.515361:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d0013869fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9785 expref: 8 pid: 6694 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607846.515420:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:1.0:1789607846.515463:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520123776:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607846.515484:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607846.515518:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d0013869fd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9785 expref: 8 pid: 6694 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.515560:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d0013869fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9785 expref: 8 pid: 6694 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.515594:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607846.515600:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607846.515611:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 8 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.515624:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 8 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.515677:0:5834:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 8 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607846.515696:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b49500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5834:1876539541104512:192.168.202.3@tcp:105: 00010000:00010000:3.0:1789607846.515768:0:8471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d0013869fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9785 expref: 8 pid: 6694 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607846.515799:0:8471:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8471:1876539541104384:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607846.515821:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e2600 going to sleep for 11 seconds 00010000:00010000:3.0:1789607846.515841:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 7 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.515858:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e2400, rc 0) 00000100:00100000:3.0:1789607846.515917:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:11384:x1876539520123648:12345-192.168.202.3@tcp:101:bash.0 Request processed in 7904us (8352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607846.515942:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:1.0:1789607846.522371:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b49500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5834:1876539541104512:192.168.202.3@tcp:105: 00010000:00010000:1.0:1789607846.522405:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607846.522535:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2374:x1876539520123776:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 7075us (7436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607846.522548:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:0.0:1789607846.525062:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607846.532110:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520124032 00000100:00100000:1.0:1789607846.532131:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520124032 00000100:00100000:1.0:1789607846.532215:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:1.0:1789607846.532228:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:11384:x1876539520124032:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:1.0:1789607846.532692:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:11384:x1876539520124032:12345-192.168.202.3@tcp:35:bash.0 Request processed in 466us (7646us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1789607846.532701:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:2.0:1789607846.539917:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541105024:0@lo:400:kworker.0 00000100:00100000:2.0:1789607846.539992:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607846.540031:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607846.540037:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541104896:0@lo:400:kworker.0 00000100:00100000:2.0:1789607846.540065:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607846.540261:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541105024 00000100:00100000:1.0:1789607846.540270:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541105024 00000100:00100000:1.0:1789607846.540330:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789607846.540341:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541105024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607846.540403:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541105024:12345-0@lo:400:kworker.0 Request processed in 64us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607846.540410:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1789607846.540452:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607846.540483:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541105024:0@lo:400:kworker.0 00000100:00100000:1.0:1789607846.540509:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541104896 00000100:00100000:1.0:1789607846.540513:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541104896 00000100:00100000:1.0:1789607846.540559:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789607846.540574:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541104896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607846.540574:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f55a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541104768:0@lo:400:kworker.0 00000100:00100000:1.0:1789607846.540644:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541104896:12345-0@lo:400:kworker.0 Request processed in 78us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607846.540651:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1789607846.540681:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607846.540700:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541104896:0@lo:400:kworker.0 00000100:00100000:3.0:1789607846.541089:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541104640:0@lo:400:kworker.0 00000100:00100000:0.0:1789607846.541134:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607846.541145:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607846.541194:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541105280:0@lo:400:kworker.0 00000100:00100000:0.0:1789607846.541234:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607846.541297:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541105280 00000100:00100000:0.0:1789607846.541305:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541105280 00000100:00100000:3.0:1789607846.541317:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541105152:0@lo:400:kworker.0 00000100:00100000:3.0:1789607846.541371:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607846.541417:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541104768 00000100:00100000:3.0:1789607846.541452:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541104768 00000100:00100000:3.0:1789607846.541485:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541105152 00000100:00100000:3.0:1789607846.541487:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541105152 00000100:00100000:3.0:1789607846.541510:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789607846.541517:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541104768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607846.541546:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789607846.541561:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541105280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607846.541572:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541104768:12345-0@lo:400:kworker.0 Request processed in 53us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607846.541580:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789607846.541600:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789607846.541609:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541105152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607846.541659:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541105152:12345-0@lo:400:kworker.0 Request processed in 52us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607846.541678:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789607846.541720:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541105152:0@lo:400:kworker.0 00000100:00100000:3.0:1789607846.541746:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f55a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541104768:0@lo:400:kworker.0 00000100:00100000:3.0:1789607846.541757:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789607846.541763:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a1e4d16300, transno 4294967312 00000100:00100000:3.0:1789607846.541772:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541105280:0@lo:400:kworker.0 00000100:00100000:0.0:1789607846.541808:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee932300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541105280:12345-0@lo:400:kworker.0 Request processed in 72us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607846.541818:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789607846.542183:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541104640 00000100:00100000:1.0:1789607846.542392:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541104640 00000100:00100000:1.0:1789607846.542469:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1789607846.542477:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541104640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607846.542536:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541104640:12345-0@lo:400:kworker.0 Request processed in 59us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607846.542543:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:1.0:1789607846.542573:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607846.542577:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607846.542770:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541104640:0@lo:400:kworker.0 00000100:00100000:0.0:1789607846.655525:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607846.655621:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520124288 00000100:00100000:1.0:1789607846.655636:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520124288 00000100:00100000:1.0:1789607846.655712:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 143 00000100:00100000:1.0:1789607846.655725:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:11394:x1876539520124288:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607846.655759:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607846.655789:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9793 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607846.655926:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789607846.656108:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9793 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.656126:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7dd00) 00010000:00010000:1.0:1789607846.656128:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607846.656134:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9793 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.656150:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4efe00, rc 0) 00000100:00100000:1.0:1789607846.656233:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:11394:x1876539520124288:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 511us (720us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1789607846.656241:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 143 00000100:00100000:0.0:1789607846.665230:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607846.665380:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520124544 00000100:00100000:3.0:1789607846.665401:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520124544 00000100:00100000:3.0:1789607846.665498:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:3.0:1789607846.665510:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:11394:x1876539520124544:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1789607846.666483:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:11394:x1876539520124544:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 967us (1255us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789607846.666495:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:0.0:1789607846.742404:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607846.742568:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520124672 00000100:00100000:2.0:1789607846.742582:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520124672 00000100:00100000:2.0:1789607846.742683:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 144 00000100:00100000:2.0:1789607846.742696:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:11400:x1876539520124672:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607846.742756:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607846.742788:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386a19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b979a expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.742878:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386a20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.742897:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.742912:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607846.742957:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789607846.742961:0:11489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607846.742982:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.743015:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386a19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b979a expref: 23 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.743038:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b979a expref: 22 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.743048:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:2.0:1789607846.743051:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607846.743056:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3400, rc 0) 00000100:00100000:2.0:1789607846.743142:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:11400:x1876539520124672:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 448us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607846.743149:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 144 00000100:00100000:0.0:1789607846.751179:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607846.751502:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520124928 00000100:00100000:1.0:1789607846.751532:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520124928 00000100:00100000:1.0:1789607846.751604:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 145 00000100:00100000:1.0:1789607846.751617:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:11400:x1876539520124928:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607846.751650:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607846.751680:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97a1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.751828:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386a2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.751843:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.751853:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386a2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607846.751863:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789607846.752022:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97a1 expref: 25 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.752045:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386a2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97a1 expref: 24 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.752052:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:1.0:1789607846.752054:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607846.752057:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef200, rc 0) 00000100:00100000:1.0:1789607846.752135:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11400:x1876539520124928:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 522us (972us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789607846.752141:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 145 00000100:00100000:3.0:1789607846.755218:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607846.755747:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520125184 00000100:00100000:0.0:1789607846.755764:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520125184 00000100:00100000:0.0:1789607846.755982:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 146 00000100:00100000:0.0:1789607846.755995:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11400:x1876539520125184:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607846.756054:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607846.756085:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386a3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97a8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.756219:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386a43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.756237:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.756252:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386a43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607846.756268:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789607846.756472:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386a3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97a8 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.756499:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386a43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97a8 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.756509:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:0.0:1789607846.756512:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789607846.756516:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c0030a00, rc 0) 00000100:00100000:0.0:1789607846.756603:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:11400:x1876539520125184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 611us (1400us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789607846.756611:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 146 00000100:00100000:0.0:1789607846.758970:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607846.759238:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520125312 00000100:00100000:2.0:1789607846.759250:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520125312 00000100:00100000:2.0:1789607846.759337:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:2.0:1789607846.759351:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:2376:x1876539520125312:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607846.759369:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607846.759402:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386a2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97a1 expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.759456:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:2.0:1789607846.759462:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607846.759516:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+25:2376:x1876539520125312:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 167us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607846.759524:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:3.0:1789607846.763295:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607846.764676:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520125440 00000100:00100000:2.0:1789607846.764695:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520125440 00000100:00100000:2.0:1789607846.764794:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:2.0:1789607846.764812:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2373:x1876539520125440:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1789607846.764928:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.764955:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 6 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.764965:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607846.764970:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607846.764975:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.765048:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 6 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.765063:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 6 pid: 8471 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607846.765081:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6694:1876539541105408:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607846.765299:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8e1bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607846.772940:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607846.773375:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6694:1876539541105408:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607846.773387:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520125568 00000100:00100000:1.0:1789607846.773396:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520125568 00010000:00010000:2.0:1789607846.773503:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1789607846.773503:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99a1ff4ae300 x1876539520125568/t0(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:402/0 lens 504/0 e 0 to 0 dl 1789607857 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789607846.773515:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1ff4ae300 with x1876539520125568 ext(0->12) 00010000:00010000:1.0:1789607846.773522:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 7 pid: 8471 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.773537:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 7 pid: 8471 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607846.773545:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99a1ff4ae300 00000100:00100000:1.0:1789607846.773582:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:1.0:1789607846.773594:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520125568:12345-192.168.202.3@tcp:4:lfs.0 00000100:00100000:1.0:1789607846.774171:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2374:x1876539520125568:12345-192.168.202.3@tcp:4:lfs.0 Request processed in 577us (1244us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789607846.774177:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00002000:00100000:1.0:1789607846.774183:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99a1ff4ae300 x1876539520125568/t4294967305(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:402/0 lens 504/448 e 0 to 0 dl 1789607857 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789607846.774189:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1ff4ae300 with x1876539520125568 ext(0->12) 00010000:00010000:1.0:1789607846.774194:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 9 pid: 8471 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.774204:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 9 pid: 8471 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607846.774216:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99a1ff4ae300 00000100:00100000:0.0:1789607846.777514:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607846.778870:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520125696 00000100:00100000:2.0:1789607846.778885:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520125696 00010000:00010000:2.0:1789607846.778941:0:8517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 9 pid: 8471 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607846.778980:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:2.0:1789607846.778990:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2376:x1876539520125696:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607846.779009:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789607846.779036:0:8517:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789607846.779040:0:8517:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789607846 00002000:00010000:2.0:1789607846.779042:0:8517:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789607846 00002000:00010000:2.0:1789607846.779045:0:8517:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789607846 00010000:00010000:2.0:1789607846.779068:0:8517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 9 pid: 8471 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.779080:0:8517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 9 pid: 8471 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.779102:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386a04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b978c expref: 9 pid: 8471 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.779120:0:8517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607846.779124:0:8517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607846.779130:0:8517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.779138:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.779174:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607846.779215:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.779226:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.779256:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.779265:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.779274:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.779282:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2800 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:3.0:1789607846.779295:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607846.779301:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2376:x1876539520125696:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 311us (1800us total) trans 0 rc 0/0 00010000:00010000:3.0:1789607846.779305:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607846.779308:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 62 00010000:00010000:3.0:1789607846.779318:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.779326:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068988f21/0x33f091d001386a51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607846.779899:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2373:x1876539520125440:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 15090us (16615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607846.779910:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:0.0:1789607846.789764:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607846.790002:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520125952 00000100:00100000:1.0:1789607846.790015:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520125952 00000100:00100000:1.0:1789607846.790134:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:1.0:1789607846.790147:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1db76c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+25:11400:x1876539520125952:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:1.0:1789607846.790229:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386a43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97a8 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789607846.790596:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1789607846.790660:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1789607846.791300:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1789607846.791373:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.791393:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013869ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b977e expref: 29 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.791403:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.791497:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013869ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b977e expref: 29 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.791514:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013869ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b977e expref: 29 pid: 6790 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607846.791530:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b49500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5850:1876539541105536:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607846.791647:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e2240 going to sleep for 11 seconds 00000100:00100000:1.0:1789607846.797060:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b49500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5850:1876539541105536:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607846.797108:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607846.798274:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607846.798579:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520126080 00000100:00100000:3.0:1789607846.798592:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520126080 00010000:00010000:3.0:1789607846.798649:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013869ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b977e expref: 30 pid: 6790 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607846.798712:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:3.0:1789607846.798725:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:2373:x1876539520126080:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607846.798745:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607846.798754:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013869ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b977e expref: 30 pid: 6790 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.798769:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013869ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b977e expref: 30 pid: 6790 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.798821:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d0013869ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b977e expref: 30 pid: 6790 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.798849:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:3.0:1789607846.798856:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.798868:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.798877:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.798910:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607846.798941:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.798950:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607846.798998:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:2373:x1876539520126080:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 276us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607846.799007:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 63 00000001:00080000:1.0:1789607846.799142:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1789607846.799998:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1789607846.800174:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201b49500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1876539541105664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789607846.800246:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607846.800290:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607846.800973:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541105664 00000100:00100000:3.0:1789607846.800994:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541105664 00000100:00100000:1.0:1789607846.801161:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789607846.801173:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876539541105664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789607846.801301:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1876539541105664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 131us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607846.801310:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607846.801452:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201b49500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1876539541105664:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789607846.802284:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789607846.802371:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f61c8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1876539541105792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789607846.802862:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607846.803899:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e4f36780 going to sleep for 11 seconds 00000100:00100000:3.0:1789607846.808199:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541105792 00000100:00100000:3.0:1789607846.808226:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541105792 00000100:00100000:3.0:1789607846.809204:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607846.809226:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1876539541105792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789607846.809624:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5850:x1876539541105792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 406us (6762us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789607846.809634:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607846.810232:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f61c8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5850:1876539541105792:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789607846.810328:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1789607846.810383:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.810406:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.810414:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.810449:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efe00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607846.810456:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.810464:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.810481:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:2.0:1789607846.810483:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789607846.810488:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.810493:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386a58 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789607846.810763:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789607846.810901:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789607846.810914:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380655490476ns, next at 381655487868ns, rc = 0 00000001:00080000:2.0:1789607846.810921:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789607846.810980:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:2.0:1789607846.810983:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789607846.810992:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386a43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97a8 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607846.811151:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1db76c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+32:11400:x1876539520125952:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 21007us (21404us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1789607846.811161:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00000020:00080000:2.0:1789607846.811167:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789607846.814666:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607846.814813:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520126208 00000100:00100000:0.0:1789607846.814829:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520126208 00000100:00100000:0.0:1789607846.814910:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 147 00000100:00100000:0.0:1789607846.814922:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+32:11400:x1876539520126208:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607846.814959:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607846.814992:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2adc00/0x33f091d001386a5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97af expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.815083:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2adc00/0x33f091d001386a5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97af expref: 33 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.815101:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2adc00/0x33f091d001386a5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97af expref: 33 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.815125:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:0.0:1789607846.815129:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607846.815134:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2adc00, rc 0) 00000100:00100000:0.0:1789607846.815215:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:11400:x1876539520126208:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 295us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607846.815223:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 147 00000100:00100000:3.0:1789607846.817905:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607846.818000:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520126464 00000100:00100000:2.0:1789607846.818013:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520126464 00000100:00100000:2.0:1789607846.818113:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:2.0:1789607846.818122:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:11400:x1876539520126464:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1789607846.818403:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:11400:x1876539520126464:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 280us (507us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789607846.818411:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:2.0:1789607846.905363:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607846.905534:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520126720 00000100:00100000:1.0:1789607846.905551:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520126720 00000100:00100000:1.0:1789607846.905618:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 148 00000100:00100000:1.0:1789607846.905626:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:11410:x1876539520126720:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607846.905662:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607846.905690:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386a66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97b6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607846.905839:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789607846.905971:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386a66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97b6 expref: 36 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.905987:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7dd00) 00010000:00010000:1.0:1789607846.905990:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607846.905996:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386a66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97b6 expref: 36 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607846.906013:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee800, rc 0) 00000100:00100000:1.0:1789607846.906080:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:11410:x1876539520126720:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 455us (730us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1789607846.906086:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 148 00000100:00100000:3.0:1789607846.910529:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607846.910803:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520126848 00000100:00100000:2.0:1789607846.910818:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520126848 00000100:00100000:2.0:1789607846.910967:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 149 00000100:00100000:2.0:1789607846.910981:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:11410:x1876539520126848:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:2.0:1789607846.911122:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386a74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911149:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386a74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911169:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386a74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911201:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386a7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911209:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911216:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911348:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386a82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911357:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911364:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607846.911467:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911485:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386a74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911492:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386a74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911500:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386a74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911512:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607846.911519:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386a74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911535:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386a74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911550:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:2.0:1789607846.911553:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607846.911559:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386a74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911565:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386a74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911582:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911588:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386a7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911594:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911599:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607846.911602:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911607:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386a7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911614:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1db790100) 00010000:00010000:2.0:1789607846.911617:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607846.911620:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386a7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911634:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386a7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911665:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911671:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386a82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911677:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911682:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607846.911685:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911691:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386a82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911698:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:2.0:1789607846.911700:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607846.911713:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386a82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607846.911719:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386a82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607846.911840:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:11410:x1876539520126848:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 861us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607846.911849:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 149 00000100:00100000:3.0:1789607846.917341:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607846.921486:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520127104 00000100:00100000:2.0:1789607846.921510:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520127104 00000100:00100000:2.0:1789607846.921662:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:2.0:1789607846.921676:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:11410:x1876539520127104:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1789607846.922042:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:11410:x1876539520127104:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 366us (4712us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1789607846.922050:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:2.0:1789607846.956116:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607846.956304:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520127360 00000100:00100000:3.0:1789607846.956317:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520127360 00000100:00100000:3.0:1789607846.956489:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 150 00000100:00100000:3.0:1789607846.956502:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:11413:x1876539520127360:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607846.956536:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607846.956562:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386a89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97bd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.956678:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386a90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.956697:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.956721:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.956738:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386a97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.956745:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.956751:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.956907:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386a9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.956917:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.956943:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607846.956955:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789607846.957328:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386a90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957338:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386a90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957346:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957352:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558e000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607846.957358:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386a90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957366:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386a90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957379:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607846.957383:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607846.957485:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957494:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957511:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386a97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957518:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386a97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957532:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957538:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607846.957541:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386a97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957548:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386a97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957557:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1c3982e00) 00010000:00010000:3.0:1789607846.957559:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607846.957563:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386a97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957570:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386a97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957623:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386a89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97bd expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957638:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97bd expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607846.957716:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:3.0:1789607846.957719:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607846.957722:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558ee00, rc 0) 00000100:00100000:3.0:1789607846.957818:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11413:x1876539520127360:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1319us (1854us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1789607846.957837:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 150 00000100:00100000:3.0:1789607846.962075:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607846.962206:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520127488 00000100:00100000:0.0:1789607846.962219:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520127488 00000100:00100000:0.0:1789607846.962346:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 151 00000100:00100000:0.0:1789607846.962360:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11413:x1876539520127488:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:0.0:1789607846.962605:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386aac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.962625:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.962655:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.962691:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386aac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.962699:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386aac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.962720:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386aac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.962726:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2acc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607846.962732:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386aac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.963294:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386aac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.963314:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:0.0:1789607846.963317:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607846.963324:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386aac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607846.963331:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386aac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607846.963630:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11413:x1876539520127488:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 1270us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607846.963640:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 151 00000100:00100000:0.0:1789607846.966492:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607846.966621:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520127744 00000100:00100000:3.0:1789607846.966636:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520127744 00000100:00100000:3.0:1789607846.966724:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:3.0:1789607846.966738:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11413:x1876539520127744:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1789607846.967083:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+39:11413:x1876539520127744:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 348us (606us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789607846.967092:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:2.0:1789607847.051807:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607847.051841:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541105920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607847.051941:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607847.052106:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541105920 00000100:00100000:3.0:1789607847.052116:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541105920 00000100:00100000:3.0:1789607847.052190:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789607847.052202:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541105920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607847.052252:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607847.052310:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541105920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607847.052317:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789607847.052489:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff9e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541105920:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789607847.095952:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967422 is committed 00000001:00080000:1.0:1789607847.095992:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967433 is committed 00000001:00080000:1.0:1789607847.096023:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000004:00080000:1.0:1789607847.096036:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789607847.096073:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a1e8e1bb40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789607847.096079:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1ee548c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a1e8e1bcc0 00000020:00080000:1.0:1789607847.096082:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1ee548100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a1da7a8800 00000001:00080000:1.0:1789607847.096111:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000004:00080000:1.0:1789607847.096132:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1789607847.096202:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789607847.096486:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789607847.096800:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541106048:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789607847.096895:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607847.097240:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541106048 00000100:00100000:0.0:1789607847.097252:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541106048 00000100:00100000:0.0:1789607847.097325:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789607847.097337:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541106048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789607847.097375:0:8471:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1789607847.097455:0:8471:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aab3fa6, atime: 0x6aab3fa6, ctime: 0x6aab3fa6, blocks: 0x1 00010000:00010000:0.0:1789607847.097467:0:8471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f025a5fc/0x33f091d001386ab3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.097489:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1789607847.097494:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607847.097501:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f025a5fc/0x33f091d001386ab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.097518:0:8471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f025a5fc/0x33f091d001386ab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.097530:0:8471:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f025a5fc/0x33f091d001386ab3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.097537:0:8471:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f025a5fc/0x33f091d001386ab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.097556:0:8471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789607847.097855:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607847.097864:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f025a5fc/0x33f091d001386ab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.097898:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2acc00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:3.0:1789607847.097903:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f025a5fc/0x33f091d001386ab3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.097913:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f025a5fc/0x33f091d001386ab3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.097935:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f025a5fc/0x33f091d001386ab3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.097942:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f025a5fc/0x33f091d001386ab3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.097968:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607847.097970:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607847.097972:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607847.099614:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1876539541106048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2272us (2711us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789607847.099628:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1789607847.100029:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a1ee292a00/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789607847.100039:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541106048:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789607847.205134:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607847.205536:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520128000 00000100:00100000:2.0:1789607847.205548:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520128000 00000100:00100000:2.0:1789607847.205638:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 152 00000100:00080000:1.0:1789607847.205740:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607847.205811:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+17:11444:x1876539520128000:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1789607847.205847:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607847.205871:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386aba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97c4 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.205984:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386ac1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.206001:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.206017:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386ac1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607847.206052:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789607847.206326:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386aba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97c4 expref: 20 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.206344:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386ac1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97c4 expref: 19 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.206351:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:2.0:1789607847.206353:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607847.206356:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3800, rc 0) 00000100:00100000:2.0:1789607847.206496:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:11444:x1876539520128000:12345-192.168.202.3@tcp:101:cat.0 Request processed in 688us (1388us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789607847.211002:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 152 00000100:00100000:1.0:1789607847.213530:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607847.213972:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607847.214082:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520128384 00000100:00100000:3.0:1789607847.214095:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520128384 00000100:00100000:3.0:1789607847.214184:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:3.0:1789607847.214197:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:11444:x1876539520128384:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:3.0:1789607847.214719:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:11444:x1876539520128384:12345-192.168.202.3@tcp:35:cat.0 Request processed in 523us (745us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789607847.214751:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:2.0:1789607847.216611:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520128128 00000100:00100000:2.0:1789607847.216642:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520128128 00000100:00100000:2.0:1789607847.216927:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:2.0:1789607847.216942:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:2375:x1876539520128128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607847.216962:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607847.216996:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386ac1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97c4 expref: 20 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.217020:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:2.0:1789607847.217026:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607847.217095:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:2375:x1876539520128128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 158us (3579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607847.217102:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:1.0:1789607847.274153:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607847.274711:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520128640 00000100:00100000:3.0:1789607847.274726:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520128640 00000100:00100000:3.0:1789607847.274929:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 153 00000100:00100000:3.0:1789607847.274942:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:11450:x1876539520128640:12345-192.168.202.3@tcp:101:dd.0 00010000:00010000:3.0:1789607847.274991:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607847.274995:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789607847.275034:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386a20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b979a expref: 19 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.275057:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607847.275063:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607847.275078:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386acf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97cb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.275205:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.275223:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386a9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97bd expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.275233:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.275278:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97bd expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.275295:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386a9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97bd expref: 19 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607847.275324:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541106176:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607847.275675:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607847.280499:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607847.280546:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520128768 00000100:00100000:3.0:1789607847.280557:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520128768 00010000:00010000:3.0:1789607847.280609:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386a9e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97bd expref: 20 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607847.280664:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 64 00000100:00100000:3.0:1789607847.280676:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:2376:x1876539520128768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607847.280697:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607847.280716:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386a9e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97bd expref: 20 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.280731:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386a9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97bd expref: 20 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.280759:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:3.0:1789607847.280765:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.280778:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.280786:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.280837:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607847.280903:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:2376:x1876539520128768:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 228us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607847.280911:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 64 00010000:00010000:1.0:1789607847.281475:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386a9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97bd expref: 19 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607847.281497:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541106176:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607847.281524:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.281534:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.281541:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607847.281565:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789607847.281789:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386acf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97cb expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.281806:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97cb expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.281815:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:1.0:1789607847.281818:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789607847.281822:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f000, rc 0) 00000100:00100000:1.0:1789607847.281876:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:11450:x1876539520128640:12345-192.168.202.3@tcp:101:dd.0 Request processed in 6937us (7739us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789607847.281884:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 153 00000100:00100000:3.0:1789607847.285331:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607847.285492:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520129024 00000100:00100000:0.0:1789607847.285506:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520129024 00000100:00100000:0.0:1789607847.285578:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 154 00000100:00100000:0.0:1789607847.285589:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:11450:x1876539520129024:12345-192.168.202.3@tcp:36:dd.0 00010000:00010000:0.0:1789607847.286006:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386ae4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.286030:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.286043:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607847.286107:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1789607847.286134:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b7276a4 reply state 000000005201aaad transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607847.286144:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789607847.286264:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:11450:x1876539520129024:12345-192.168.202.3@tcp:36:dd.0 Request processed in 676us (950us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789607847.286273:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 154 00000020:00080000:0.0:1789607847.286279:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789607847.292190:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386ae4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.292215:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386ae4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.292224:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386ae4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.292231:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ad400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607847.292257:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386ae4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.292267:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386ae4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.292289:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:0.0:1789607847.292293:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607847.292299:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386ae4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.292306:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386ae4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.308061:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607847.539320:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607847.541029:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520129152 00000100:00100000:2.0:1789607847.541049:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520129152 00000100:00100000:2.0:1789607847.541197:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 155 00000100:00100000:2.0:1789607847.541211:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:11464:x1876539520129152:12345-192.168.202.3@tcp:101:stat.0 00010000:00010000:2.0:1789607847.541247:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607847.541279:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386aeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97d2 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.541371:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386af2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.541399:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386af2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.541414:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386af2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.541486:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386af9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.541495:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.541502:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.542317:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386b00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.542337:0:11489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97cb expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.542361:0:11489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386b00 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.543938:0:11489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97cb expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.543968:0:11489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97cb expref: 22 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607847.543989:0:11489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee933100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541106304:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607847.544365:0:11489:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db3600 going to sleep for 11 seconds 00000100:00100000:3.0:1789607847.547025:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607847.547286:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520129408 00000100:00100000:0.0:1789607847.547298:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520129408 00000100:00100000:0.0:1789607847.547385:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:0.0:1789607847.547397:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:5614:x1876539520129408:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789607847.547406:0:11489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee933100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541106304:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607847.547479:0:11489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386b00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607847.548171:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:5614:x1876539520129408:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 771us (1154us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789607847.548182:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:3.0:1789607847.550082:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607847.550201:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520129536 00000100:00100000:1.0:1789607847.550213:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520129536 00010000:00010000:1.0:1789607847.550265:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97cb expref: 24 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607847.550332:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 65 00000100:00100000:1.0:1789607847.550343:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:2373:x1876539520129536:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607847.550363:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607847.550371:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97cb expref: 24 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.550394:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97cb expref: 24 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.550448:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ad6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97cb expref: 24 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.550472:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:1.0:1789607847.550479:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386b00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.550490:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386b00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.550499:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386b00 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.550583:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607847.550662:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:2373:x1876539520129536:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 320us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607847.550671:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 65 00010000:00010000:3.0:1789607847.551868:0:11489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386b00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.551885:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386b00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607847.551950:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789607847.551957:0:11489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607847.552005:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386b00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552024:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386b00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552036:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386af2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552043:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386af2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552050:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386af2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552076:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607847.552081:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386af2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552089:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386af2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552105:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607847.552108:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607847.552113:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386af2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552119:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386af2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552135:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386af9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552141:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386af9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552147:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386af9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552152:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2c00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607847.552154:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386af9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552161:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386af9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552182:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1db790600) 00010000:00010000:3.0:1789607847.552184:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607847.552188:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386af9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552194:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386af9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552249:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386aeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97d2 expref: 23 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552266:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386b00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97d2 expref: 22 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.552274:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:3.0:1789607847.552277:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607847.552279:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e2200, rc 0) 00000100:00100000:3.0:1789607847.552358:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:11464:x1876539520129152:12345-192.168.202.3@tcp:101:stat.0 Request processed in 11150us (13052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607847.552368:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 155 00000100:00100000:3.0:1789607847.614866:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607847.615218:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520129792 00000100:00100000:0.0:1789607847.615231:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520129792 00000100:00100000:0.0:1789607847.615308:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 156 00000100:00100000:0.0:1789607847.615320:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:11470:x1876539520129792:12345-192.168.202.3@tcp:36:truncate.0 00010000:00010000:0.0:1789607847.615408:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607847.615487:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386b00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97d2 expref: 22 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.615535:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:0.0:1789607847.615542:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607847.615828:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac000/0x33f091d001386b07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.615845:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac000/0x33f091d001386b07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.615858:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac000/0x33f091d001386b07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607847.616489:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1789607847.616526:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbf6daab reply state 0000000020882f50 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac000/0x33f091d001386b07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607847.616538:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789607847.617565:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11470:x1876539520129792:12345-192.168.202.3@tcp:36:truncate.0 Request processed in 2240us (2708us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789607847.617577:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 156 00000020:00080000:0.0:1789607847.617585:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789607847.620249:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac000/0x33f091d001386b07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.620271:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac000/0x33f091d001386b07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.620280:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac000/0x33f091d001386b07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.620306:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607847.620312:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac000/0x33f091d001386b07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.620322:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac000/0x33f091d001386b07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.620342:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:3.0:1789607847.620346:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607847.620353:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac000/0x33f091d001386b07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.620359:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac000/0x33f091d001386b07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607847.750620:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607847.750904:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520129920 00000100:00100000:1.0:1789607847.750942:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520129920 00000100:00100000:1.0:1789607847.751041:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 157 00000100:00100000:1.0:1789607847.751054:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:11484:x1876539520129920:12345-192.168.202.3@tcp:101:stat.0 00010000:00010000:1.0:1789607847.751087:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607847.751120:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386b0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97d9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.751209:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386b15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.751226:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386b15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.751242:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386b15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.751260:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386b1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.751267:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.751273:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.751871:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.751884:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.751892:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607847.751948:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789607847.751954:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607847.752058:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752074:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752083:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386b15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752090:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386b15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752098:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386b15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752104:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eee00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607847.752109:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386b15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752118:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386b15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752134:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:1.0:1789607847.752137:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607847.752142:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386b15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752149:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386b15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752175:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386b1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752184:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386b1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752189:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386b1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752194:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607847.752197:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386b1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752204:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386b1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752212:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1dab7d300) 00010000:00010000:1.0:1789607847.752215:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607847.752218:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386b1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752223:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386b1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752264:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386b0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97d9 expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752279:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97d9 expref: 24 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.752295:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:1.0:1789607847.752298:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607847.752301:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee800, rc 0) 00000100:00100000:1.0:1789607847.752390:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11484:x1876539520129920:12345-192.168.202.3@tcp:101:stat.0 Request processed in 1338us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607847.752400:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 157 00000100:00100000:2.0:1789607847.839791:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607847.839972:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520130176 00000100:00100000:3.0:1789607847.839998:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520130176 00000100:00100000:3.0:1789607847.840077:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 158 00000100:00100000:3.0:1789607847.840089:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11494:x1876539520130176:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607847.840118:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607847.840146:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386b2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97e0 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607847.840267:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789607847.840590:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386b2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97e0 expref: 26 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.840608:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7dd00) 00010000:00010000:3.0:1789607847.840630:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607847.840709:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386b2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97e0 expref: 26 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.840727:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e000, rc 0) 00000100:00100000:3.0:1789607847.840815:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+25:11494:x1876539520130176:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 729us (1042us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1789607847.840823:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 158 00000100:00100000:0.0:1789607847.844587:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607847.844722:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520130432 00000100:00100000:3.0:1789607847.844776:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520130432 00000100:00100000:3.0:1789607847.844856:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:3.0:1789607847.844869:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1db76e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+25:11494:x1876539520130432:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1789607847.845203:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1db76e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:11494:x1876539520130432:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 336us (630us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789607847.845211:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:1.0:1789607847.914059:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607847.914112:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520130688 00000100:00100000:3.0:1789607847.914126:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520130688 00000100:00100000:3.0:1789607847.914204:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 159 00000100:00100000:3.0:1789607847.914217:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:11500:x1876539520130688:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1789607847.914250:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607847.914277:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386b38 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97e7 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.915540:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.915569:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97d9 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.915599:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.915778:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97d9 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.915797:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97d9 expref: 27 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607847.915814:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541106432:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607847.915955:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607847.919832:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607847.920029:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520130816 00000100:00100000:0.0:1789607847.920042:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520130816 00010000:00010000:0.0:1789607847.920099:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97d9 expref: 28 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607847.920154:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:0.0:1789607847.920166:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:2374:x1876539520130816:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607847.920205:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607847.920214:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97d9 expref: 28 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.920229:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97d9 expref: 28 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.920256:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:0.0:1789607847.920262:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.920273:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.920282:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.920306:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607847.920388:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:2374:x1876539520130816:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 225us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607847.920396:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 66 00010000:00010000:3.0:1789607847.923271:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386b23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97d9 expref: 27 pid: 5848 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607847.923306:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541106432:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607847.923338:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.923349:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.923355:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607847.923514:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789607847.925189:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386b38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97e7 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.925254:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97e7 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.925264:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:3.0:1789607847.925267:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789607847.925272:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558fc00, rc 0) 00000100:00100000:3.0:1789607847.925366:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:11500:x1876539520130688:12345-192.168.202.3@tcp:101:bash.0 Request processed in 11150us (11321us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789607847.927958:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 159 00000100:00100000:1.0:1789607847.928499:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607847.928665:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520131072 00000100:00100000:2.0:1789607847.928677:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520131072 00000100:00100000:2.0:1789607847.928743:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 160 00000100:00100000:2.0:1789607847.928755:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:11500:x1876539520131072:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:2.0:1789607847.929119:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386b4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.929137:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607847.929148:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607847.929217:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1789607847.929237:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000134c99c1 reply state 00000000686b8ade transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607847.929244:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607847.929341:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:11500:x1876539520131072:12345-192.168.202.3@tcp:36:bash.0 Request processed in 588us (843us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1789607847.929346:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 160 00000020:00080000:2.0:1789607847.929350:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789607847.932837:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386b4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.932862:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386b4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.932871:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386b4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.932877:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607847.932883:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386b4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.932893:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386b4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.932913:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:3.0:1789607847.932917:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607847.932923:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386b4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.932951:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3000/0x33f091d001386b4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607847.938663:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607847.938865:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520131200 00000100:00100000:0.0:1789607847.938878:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520131200 00000100:00100000:0.0:1789607847.938957:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 161 00000100:00100000:0.0:1789607847.938970:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:11500:x1876539520131200:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:0.0:1789607847.939019:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607847.939046:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386b54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97ee expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.939164:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001386b5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.939180:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97e7 expref: 30 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.939189:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001386b5b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.939226:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97e7 expref: 30 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607847.939239:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97e7 expref: 30 pid: 5849 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607847.939255:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee292300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876539541106560:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607847.939345:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789607847.945291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607847.945361:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520131328 00000100:00100000:3.0:1789607847.945373:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520131328 00010000:00010000:3.0:1789607847.945449:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97e7 expref: 31 pid: 5849 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607847.945495:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 67 00000100:00100000:3.0:1789607847.945505:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:2374:x1876539520131328:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607847.945523:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607847.945531:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97e7 expref: 31 pid: 5849 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.945545:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97e7 expref: 31 pid: 5849 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.945572:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:3.0:1789607847.945579:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001386b5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.945592:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001386b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.945601:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001386b5b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607847.945621:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607847.945725:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:2374:x1876539520131328:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 221us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607847.945734:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 67 00010000:00010000:1.0:1789607847.947009:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b3f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97e7 expref: 30 pid: 5849 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607847.947036:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee292300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5847:1876539541106560:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607847.947065:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001386b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.947077:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001386b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.947082:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001386b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607847.947144:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789607847.947150:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607847.947174:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001386b5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.947737:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386b54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97ee expref: 30 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.947762:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001386b5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97ee expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607847.947771:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:1.0:1789607847.947774:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607847.947778:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ad000, rc 0) 00000100:00100000:1.0:1789607847.947862:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:11500:x1876539520131200:12345-192.168.202.3@tcp:101:bash.0 Request processed in 8894us (9213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607847.947871:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 161 00000100:00100000:0.0:1789607847.953886:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607847.953989:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520131584 00000100:00100000:1.0:1789607847.954004:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520131584 00000100:00100000:1.0:1789607847.954077:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:1.0:1789607847.954090:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:11500:x1876539520131584:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:1.0:1789607847.954464:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:11500:x1876539520131584:12345-192.168.202.3@tcp:35:bash.0 Request processed in 375us (592us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1789607847.954472:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:2.0:1789607848.044493:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.044600:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520131840 00000100:00100000:3.0:1789607848.044613:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520131840 00000100:00100000:3.0:1789607848.044708:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 162 00000100:00100000:3.0:1789607848.044721:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+30:11510:x1876539520131840:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607848.044755:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607848.044784:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386b62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97f5 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607848.044919:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789607848.045098:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386b62 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97f5 expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.045117:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7dd00) 00010000:00010000:3.0:1789607848.045120:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607848.045126:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386b62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97f5 expref: 32 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.045143:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e000, rc 0) 00000100:00100000:3.0:1789607848.045224:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:11510:x1876539520131840:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 506us (748us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1789607848.045233:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 162 00000100:00100000:0.0:1789607848.053730:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.053835:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520131968 00000100:00100000:3.0:1789607848.053850:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520131968 00000100:00100000:3.0:1789607848.053928:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 163 00000100:00100000:3.0:1789607848.053941:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:11510:x1876539520131968:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:3.0:1789607848.054074:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054096:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054110:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054129:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386b77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054137:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386b77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054144:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386b77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054563:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386b7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054576:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054585:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607848.054643:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054660:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054680:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054689:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054707:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607848.054712:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054721:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054735:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607848.054738:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607848.054744:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054750:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386b70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054763:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386b77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054768:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386b77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054774:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386b77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054779:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607848.054788:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386b77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054796:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386b77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054804:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1c3982e00) 00010000:00010000:3.0:1789607848.054807:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607848.054810:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386b77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054816:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386b77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054832:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386b7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054838:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386b7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054844:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386b7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054850:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607848.054852:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386b7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054858:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386b7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054864:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:3.0:1789607848.054867:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607848.054878:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386b7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.054885:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386b7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607848.054990:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:11510:x1876539520131968:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 1051us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607848.054999:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 163 00000100:00100000:0.0:1789607848.059386:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607848.059533:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520132224 00000100:00100000:2.0:1789607848.059548:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520132224 00000100:00100000:2.0:1789607848.059627:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:2.0:1789607848.059648:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:11510:x1876539520132224:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1789607848.059984:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+32:11510:x1876539520132224:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 346us (612us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789607848.059993:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:1.0:1789607848.097419:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607848.097578:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520132480 00000100:00100000:0.0:1789607848.097592:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520132480 00000100:00100000:0.0:1789607848.097680:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 164 00000100:00100000:0.0:1789607848.097704:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+32:11513:x1876539520132480:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607848.097739:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607848.097780:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386b85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b97fc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.097882:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001386b8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.097899:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001386b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.097913:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001386b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.097929:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386b93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.097935:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.097941:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098346:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386b9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098357:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098364:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607848.098375:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789607848.098544:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001386b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098563:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001386b8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098571:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001386b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098579:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607848.098585:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001386b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098593:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001386b8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098607:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:0.0:1789607848.098611:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607848.098616:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001386b8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098623:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001386b8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098640:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098646:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386b93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098653:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098658:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607848.098667:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098675:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386b93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098683:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1f911d600) 00010000:00010000:0.0:1789607848.098686:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607848.098689:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386b93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098706:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386b93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098763:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386b85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97fc expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098780:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386b9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97fc expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.098788:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:0.0:1789607848.098790:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607848.098793:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2acc00, rc 0) 00000100:00100000:0.0:1789607848.098888:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:11513:x1876539520132480:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1197us (1491us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1789607848.098896:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 164 00000100:00100000:0.0:1789607848.103205:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607848.103260:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.103352:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520132736 00000100:00100000:3.0:1789607848.103365:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520132736 00000100:00100000:3.0:1789607848.103489:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:3.0:1789607848.103503:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:2373:x1876539520132736:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607848.103523:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607848.103557:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2acc00/0x33f091d001386b9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97fc expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.103584:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:3.0:1789607848.103591:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607848.103668:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee290000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:2373:x1876539520132736:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 169us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607848.103677:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:2.0:1789607848.103900:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520132608 00000100:00100000:2.0:1789607848.103906:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520132608 00000100:00100000:2.0:1789607848.103960:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 165 00000100:00100000:2.0:1789607848.103968:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:11513:x1876539520132608:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:2.0:1789607848.104045:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ba8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.104064:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.104102:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.104138:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ba8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.104146:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ba8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.104154:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.104161:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607848.104167:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ba8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.104176:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ba8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.104186:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:2.0:1789607848.104189:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607848.104193:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ba8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.104201:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ba8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607848.104245:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:11513:x1876539520132608:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 278us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607848.104252:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 165 00000100:00100000:1.0:1789607848.106845:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.107136:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520132992 00000100:00100000:3.0:1789607848.107148:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520132992 00000100:00100000:3.0:1789607848.107217:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:3.0:1789607848.107231:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+33:11513:x1876539520132992:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1789607848.107821:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:11513:x1876539520132992:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 592us (988us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789607848.107854:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:1.0:1789607848.250317:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607848.250482:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520133248 00000100:00100000:2.0:1789607848.250720:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520133248 00000100:00100000:2.0:1789607848.250810:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 166 00000100:00100000:2.0:1789607848.250823:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:11531:x1876539520133248:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:2.0:1789607848.251616:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607848.251650:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386baf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9803 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.251802:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386bb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.251820:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.251838:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386bb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607848.251851:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789607848.260096:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386baf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9803 expref: 37 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.260137:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386bb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9803 expref: 36 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.260148:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:2.0:1789607848.260151:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789607848.260157:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3c00, rc 0) 00000100:00100000:2.0:1789607848.260270:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:11531:x1876539520133248:12345-192.168.202.3@tcp:101:cat.0 Request processed in 9449us (9966us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789607848.260280:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 166 00000100:00100000:0.0:1789607848.292180:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.292781:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520133376 00000100:00100000:3.0:1789607848.292799:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520133376 00000100:00100000:0.0:1789607848.293708:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 167 00000100:00100000:0.0:1789607848.293749:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:11532:x1876539520133376:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607848.293786:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607848.293816:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386bc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b980a expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.293920:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386bcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.293937:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.293952:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607848.293998:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789607848.294002:0:11489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607848.294023:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386bcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.294055:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386bc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b980a expref: 38 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.294082:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386bcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b980a expref: 37 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.294092:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:0.0:1789607848.294095:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607848.294099:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ac800, rc 0) 00000100:00100000:0.0:1789607848.294199:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:11532:x1876539520133376:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 458us (2036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607848.294217:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 167 00000100:00100000:3.0:1789607848.298705:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607848.304760:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520133760 00000100:00100000:1.0:1789607848.304783:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520133760 00000100:00100000:1.0:1789607848.304896:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:1.0:1789607848.304911:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:11532:x1876539520133760:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1789607848.306273:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11532:x1876539520133760:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 1356us (7589us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789607848.306287:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:1.0:1789607848.318622:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.318778:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520133888 00000100:00100000:3.0:1789607848.318792:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520133888 00000100:00100000:3.0:1789607848.318881:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1789607848.318893:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11532:x1876539520133888:12345-192.168.202.3@tcp:103:lfs.0 00010000:00010000:3.0:1789607848.318914:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789607848.318948:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001386b5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97ee expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.318980:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386bb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9803 expref: 37 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.318994:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2adc00/0x33f091d001386a5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b97af expref: 36 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.319004:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911df00) 00010000:00010000:3.0:1789607848.319018:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607848.319570:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:11532:x1876539520133888:12345-192.168.202.3@tcp:103:lfs.0 Request processed in 675us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607848.319580:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00010000:00010000:3.0:1789607848.332044:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607848.334061:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607848.334181:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520134016 00000100:00100000:2.0:1789607848.334194:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520134016 00000100:00100000:2.0:1789607848.334272:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 168 00000100:00100000:2.0:1789607848.334286:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:11532:x1876539520134016:12345-192.168.202.3@tcp:58:lfs.0 00010000:00010000:2.0:1789607848.334481:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386bd2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.334503:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.334518:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607848.335008:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789607848.335135:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:11532:x1876539520134016:12345-192.168.202.3@tcp:58:lfs.0 Request processed in 851us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607848.335145:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 168 00000100:00100000:1.0:1789607848.373982:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607848.374207:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520134144 00000100:00100000:2.0:1789607848.374221:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520134144 00000100:00100000:2.0:1789607848.374308:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 169 00000100:00100000:2.0:1789607848.374320:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:11534:x1876539520134144:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607848.374349:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607848.374379:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386bd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9811 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.374709:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386be0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.374730:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386be0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.374765:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386be0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.374784:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386be7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.374790:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.374796:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.376218:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.376240:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.376250:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607848.376305:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789607848.376311:0:6790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607848.376338:0:6790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.376352:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.376363:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386be0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.376383:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386be0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.376392:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386be0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.376399:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607848.376405:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386be0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.376414:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386be0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.376979:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:2.0:1789607848.376986:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607848.376993:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386be0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.377000:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386be0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.377018:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386be7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.377024:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386be7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.377030:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386be7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.377035:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2e00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607848.377049:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386be7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.377056:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386be7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.377064:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1db790700) 00010000:00010000:2.0:1789607848.377067:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607848.377070:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386be7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.377076:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386be7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.377135:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386bd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9811 expref: 37 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.377152:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9811 expref: 36 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.377159:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:2.0:1789607848.377162:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607848.377164:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3a00, rc 0) 00000100:00100000:2.0:1789607848.377266:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:11534:x1876539520134144:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 2947us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607848.377276:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 169 00000040:00080000:3.0:1789607848.396006:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607848.396019:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607848.400336:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789607848.400366:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789607848.402369:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1876539541106688:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789607848.402959:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607848.406937:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1876539541106688:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789607848.412234:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607848.412667:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520134272 00000100:00100000:1.0:1789607848.412682:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520134272 00000100:00100000:1.0:1789607848.412776:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 170 00000100:00100000:1.0:1789607848.412792:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:11537:x1876539520134272:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789607848.412840:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789607848.412997:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:11537:x1876539520134272:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 208us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607848.413008:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 170 00000100:00100000:1.0:1789607848.416032:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607848.417803:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520134400 00000100:00100000:0.0:1789607848.417823:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520134400 00000100:00100000:0.0:1789607848.418043:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 171 00000100:00100000:0.0:1789607848.418057:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:11537:x1876539520134400:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789607848.418163:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386bf5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418185:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418200:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418219:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386bfc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418227:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386bfc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418234:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386bfc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418266:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386c03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418274:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418305:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607848.418354:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789607848.418359:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607848.418375:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418389:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386bf5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418397:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386bf5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418405:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418412:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ad800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607848.418417:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386bf5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418479:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386bf5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418494:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1f911d000) 00010000:00010000:0.0:1789607848.418496:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607848.418502:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386bf5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418510:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386bf5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418551:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386bfc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418558:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386bfc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418566:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386bfc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418572:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ace00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607848.418575:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386bfc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418582:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386bfc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418590:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff99a1f911d600) 00010000:00010000:0.0:1789607848.418593:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607848.418596:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386bfc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418602:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386bfc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418622:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386c03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418628:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386c03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418634:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418645:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607848.418648:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386c03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418654:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386c03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418662:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:0.0:1789607848.418664:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607848.418667:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386c03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.418672:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386c03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607848.418786:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:11537:x1876539520134400:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 Request processed in 731us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607848.418794:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 171 00000100:00100000:2.0:1789607848.427775:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607848.428068:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520134656 00000100:00100000:0.0:1789607848.428082:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520134656 00000100:00100000:0.0:1789607848.428159:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 172 00000100:00100000:0.0:1789607848.428171:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:11537:x1876539520134656:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607848.428200:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607848.428228:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386c0a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9818 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.428360:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386c11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.428398:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.428412:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607848.428949:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789607848.429809:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386c11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.429826:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386c11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.429836:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.429843:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ad400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607848.429849:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386c11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.429858:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386c11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.429955:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:1.0:1789607848.429959:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607848.429967:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386c11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.429975:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d001386c11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.430049:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386c0a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9818 expref: 38 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.430061:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1f911d000) 00010000:00010000:1.0:1789607848.430064:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607848.430068:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386c0a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9818 expref: 38 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.430079:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ad600, rc 0) 00000100:00100000:1.0:1789607848.432159:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:11537:x1876539520134656:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 2253us (2674us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1789607848.432175:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 172 00000100:00100000:1.0:1789607848.447319:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607848.447583:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520134784 00000100:00100000:0.0:1789607848.447598:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520134784 00000100:00100000:0.0:1789607848.447684:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 173 00000100:00100000:0.0:1789607848.447708:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:11537:x1876539520134784:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789607848.450597:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789607848.450813:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:11537:x1876539520134784:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 3099us (3760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607848.450828:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 173 00000100:00100000:3.0:1789607848.455959:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607848.459678:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520135040 00000100:00100000:0.0:1789607848.459713:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520135040 00000100:00100000:2.0:1789607848.460597:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 174 00000100:00100000:2.0:1789607848.460613:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:11537:x1876539520135040:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607848.460664:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607848.460669:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789607848.460716:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386bcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b980a expref: 37 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.460756:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:2.0:1789607848.460764:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607848.460783:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386c1f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b981f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789607848.465649:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789607848.466475:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386c26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.466498:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.466514:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386c26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.466606:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386c1f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b981f expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.466630:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386c26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b981f expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.466640:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1db790700) 00010000:00010000:2.0:1789607848.466643:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607848.466657:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e2600, rc 0) 00000100:00100000:2.0:1789607848.467387:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11537:x1876539520135040:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 6774us (11440us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789607848.467399:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 174 00000100:00100000:1.0:1789607848.471735:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.471899:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520135296 00000100:00100000:3.0:1789607848.471915:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520135296 00000100:00100000:3.0:1789607848.472003:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 175 00000100:00100000:3.0:1789607848.472017:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11537:x1876539520135296:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789607848.472099:0:6790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607848.472135:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386c26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b981f expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472158:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1db790700) 00010000:00010000:3.0:1789607848.472173:0:6790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607848.472201:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472216:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472228:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472575:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa57dc25b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472600:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa57dc25b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472632:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa57dc25b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472854:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472863:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472872:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472878:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607848.472884:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472892:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472904:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607848.472907:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607848.472912:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472918:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472929:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa57dc25b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472935:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa57dc25b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472946:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa57dc25b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472951:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607848.472954:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa57dc25b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472960:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa57dc25b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472966:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa57dc25b (ffff99a1c3982e00) 00010000:00010000:3.0:1789607848.472968:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607848.472971:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa57dc25b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.472976:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa57dc25b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607848.473080:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:11537:x1876539520135296:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 1062us (1365us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789607848.473088:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 175 00000100:00100000:0.0:1789607848.486043:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607848.486127:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520135424 00000100:00100000:1.0:1789607848.486141:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520135424 00000100:00100000:1.0:1789607848.486229:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 176 00000100:00100000:1.0:1789607848.486243:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:11537:x1876539520135424:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607848.486273:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607848.486318:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386c42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9826 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.488006:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386c49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.488035:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.488050:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.488195:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386c42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9826 expref: 39 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.488219:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9826 expref: 38 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.488230:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1dab7d300) 00010000:00010000:1.0:1789607848.488234:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789607848.488239:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4eec00, rc 0) 00000100:00100000:1.0:1789607848.488341:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11537:x1876539520135424:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 2100us (2324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607848.490416:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 176 00000100:00100000:1.0:1789607848.493071:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.493761:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520135680 00000100:00100000:3.0:1789607848.493777:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520135680 00000100:00100000:3.0:1789607848.493862:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 177 00000100:00100000:3.0:1789607848.493876:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11537:x1876539520135680:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789607848.493996:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.494021:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.494045:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607848.495775:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1789607848.495801:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382340377202ns, next at 383340372880ns, rc = 0 00000004:00010000:3.0:1789607848.495940:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070616210 reply state 00000000a8ba1836 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607848.495953:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607848.496105:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+40:11537:x1876539520135680:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 2227us (3045us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789607848.496116:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 177 00000100:00100000:0.0:1789607848.503904:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607848.504599:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520135808 00000100:00100000:1.0:1789607848.504614:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520135808 00000100:00100000:1.0:1789607848.504698:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 178 00000100:00100000:1.0:1789607848.504712:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+40:11537:x1876539520135808:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607848.504767:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607848.504794:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386c57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b982d expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.504875:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386c57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b982d expref: 41 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.507494:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.507582:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.507592:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.507603:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607848.507609:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.507621:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.507712:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1dab7d300) 00010000:00010000:3.0:1789607848.507716:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789607848.507732:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.507740:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.513026:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386c57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b982d expref: 40 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.513099:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1dab7d300) 00010000:00010000:1.0:1789607848.513103:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789607848.513110:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef800, rc 0) 00000100:00100000:1.0:1789607848.513230:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+40:11537:x1876539520135808:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 8518us (9338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607848.513241:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 178 00000100:00100000:0.0:1789607848.527196:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.527305:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520135936 00000100:00100000:3.0:1789607848.527319:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520135936 00000100:00100000:3.0:1789607848.527443:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:3.0:1789607848.527457:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+6:2374:x1876539520135936:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789607848.527937:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520135936:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 482us (754us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789607848.527947:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00080000:0.0:1789607848.528600:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607848.531622:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.531809:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520136192 00000100:00100000:3.0:1789607848.531825:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520136192 00000100:00100000:3.0:1789607848.531902:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:3.0:1789607848.531915:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+40:11537:x1876539520136192:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789607848.533184:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+41:11537:x1876539520136192:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 1262us (1567us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789607848.533199:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:0.0:1789607848.538281:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607848.538451:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520136448 00000100:00100000:2.0:1789607848.538466:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520136448 00000100:00100000:2.0:1789607848.538619:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 179 00000100:00100000:2.0:1789607848.538750:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+41:11537:x1876539520136448:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789607848.538941:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+41:11537:x1876539520136448:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 312us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607848.538950:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 179 00000100:00100000:0.0:1789607848.549067:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.557232:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520136576 00000100:00100000:3.0:1789607848.557254:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520136576 00000100:00100000:3.0:1789607848.557342:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 180 00000100:00100000:3.0:1789607848.557355:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+41:11537:x1876539520136576:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607848.557393:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607848.557443:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c5e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9834 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.557578:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.557596:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.557609:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607848.557791:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607848.557817:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.557850:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386c5e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9834 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.557870:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9834 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.557879:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1dab7d300) 00010000:00010000:3.0:1789607848.557882:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789607848.557887:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f000, rc 0) 00000100:00100000:3.0:1789607848.557980:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+42:11537:x1876539520136576:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 626us (8927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607848.557987:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 180 00000100:00100000:2.0:1789607848.563091:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607848.564713:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520136704 00000100:00100000:0.0:1789607848.564732:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520136704 00000100:00100000:0.0:1789607848.564814:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:0.0:1789607848.564827:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2375:x1876539520136704:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607848.564862:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607848.564891:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f025a5fc/0x33f091d001386c6c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b983b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607848.564929:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab3fa8, blocks: 0x1 00010000:00010000:0.0:1789607848.564958:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=382s v=(0 0) 00010000:00010000:0.0:1789607848.564963:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607848.564974:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f025a5fc/0x33f091d001386c6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b983b expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.564997:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f025a5fc/0x33f091d001386c6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b983b expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.565013:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2acc00, rc 0) 00000100:00100000:0.0:1789607848.565098:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2375:x1876539520136704:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 273us (2022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607848.565107:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:3.0:1789607848.570125:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607848.570465:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520136960 00000100:00100000:0.0:1789607848.570480:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520136960 00000100:00100000:0.0:1789607848.571829:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 181 00000100:00100000:0.0:1789607848.571855:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+42:11537:x1876539520136960:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789607848.572025:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+42:11537:x1876539520136960:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 181us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607848.583048:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.583231:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520137088 00000100:00100000:3.0:1789607848.583245:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520137088 00000100:00100000:3.0:1789607848.583322:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:3.0:1789607848.583333:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:11537:x1876539520137088:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607848.583356:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607848.583378:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9842 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.583445:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f025a5fc/0x33f091d001386c6c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b983b expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.583456:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607848.583461:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607848.583467:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9842 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.583513:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f025a5fc/0x33f091d001386c6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b983b expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.583528:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f025a5fc/0x33f091d001386c6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b983b expref: 9 pid: 6692 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607848.583544:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876539541106816:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607848.583654:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1789607848.585271:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876539541106816:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607848.585310:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9842 expref: 9 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.585334:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558fc00, rc 0) 00000100:00100000:1.0:1789607848.585409:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:11537:x1876539520137088:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 2078us (2375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607848.585440:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:3.0:1789607848.585835:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.585904:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520137216 00000100:00100000:3.0:1789607848.585912:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520137216 00010000:00010000:3.0:1789607848.585952:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f025a5fc/0x33f091d001386c6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b983b expref: 9 pid: 6692 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607848.586255:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:3.0:1789607848.586267:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2374:x1876539520137216:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607848.586284:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607848.586312:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f025a5fc/0x33f091d001386c6c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b983b expref: 9 pid: 6692 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.586324:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f025a5fc/0x33f091d001386c6c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b983b expref: 9 pid: 6692 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.586347:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f025a5fc/0x33f091d001386c6c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b983b expref: 9 pid: 6692 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.586362:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607848.586366:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607848.586379:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9842 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.586391:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9842 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.586457:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9842 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607848.586469:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5833:1876539541106944:192.168.202.3@tcp:105: 00000100:00100000:3.0:1789607848.586535:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1789607848.587383:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 181 00000100:00100000:1.0:1789607848.588396:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541107072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607848.588537:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607848.588715:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541107072 00000100:00100000:2.0:1789607848.588736:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541107072 00000100:00080000:3.0:1789607848.588796:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607848.588950:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789607848.588963:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876539541107072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607848.589011:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607848.589613:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5833:1876539541106944:192.168.202.3@tcp:105: 00010000:00010000:3.0:1789607848.589636:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607848.589697:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520137216:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 3421us (3852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607848.589708:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:3.0:1789607848.590758:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.590789:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520137344 00000100:00100000:3.0:1789607848.590796:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520137344 00002000:00100000:3.0:1789607848.590846:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99a1c8dc2680 x1876539520137344/t0(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:404/0 lens 504/0 e 0 to 0 dl 1789607859 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789607848.590857:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1c8dc2680 with x1876539520137344 ext(0->8) 00002000:00010000:3.0:1789607848.590862:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1c8dc2680 00000100:00100000:3.0:1789607848.590885:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1789607848.590894:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520137344:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789607848.591451:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876539541107072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2487us (2909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607848.591456:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:2374:x1876539520137344:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 Request processed in 562us (703us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789607848.591463:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789607848.591464:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00002000:00100000:3.0:1789607848.591470:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99a1c8dc2680 x1876539520137344/t4294967314(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:404/0 lens 504/448 e 0 to 0 dl 1789607859 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789607848.591478:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1c8dc2680 with x1876539520137344 ext(0->8) 00002000:00010000:3.0:1789607848.591482:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1c8dc2680 00000100:00100000:1.0:1789607848.592996:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541107072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607848.594899:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607848.594980:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520137472 00000100:00100000:1.0:1789607848.594993:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520137472 00000100:00100000:1.0:1789607848.595065:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 182 00000100:00100000:1.0:1789607848.595077:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+42:11537:x1876539520137472:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789607848.628349:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000001:00080000:1.0:1789607848.628382:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:1.0:1789607848.628397:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:1.0:1789607848.628416:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1789607848.628444:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1789607848.628481:0:5869:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1789607848.628509:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1789607848.628520:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789607848.628841:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541107200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789607848.628939:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607848.629016:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541107200 00000100:00100000:1.0:1789607848.629026:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541107200 00000100:00100000:1.0:1789607848.629093:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789607848.629102:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541107200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789607848.629310:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789607848.629314:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789607848 00002000:00010000:1.0:1789607848.629317:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789607848.629319:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789607848 -> 1789607848 00002000:00010000:1.0:1789607848.629322:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789607848.629366:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876539541107200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 264us (427us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789607848.629394:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1789607848.629448:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789607848.629486:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a1e4f4e680/2, rc 0, transno 4294967315 00000100:00100000:1.0:1789607848.629492:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541107200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789607848.629827:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:11537:x1876539520137472:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 Request processed in 34748us (34935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607848.629846:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 182 00000100:00100000:0.0:1789607848.634668:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607848.635343:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520137600 00000100:00100000:1.0:1789607848.635359:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520137600 00000100:00100000:1.0:1789607848.635931:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:1.0:1789607848.635948:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:2376:x1876539520137600:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789607848.673809:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1789607848.674090:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:2376:x1876539520137600:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 Request processed in 38138us (39428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607848.674105:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 55 00000001:00080000:0.0:1789607848.674176:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1789607848.677363:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607848.677477:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520137856 00000100:00100000:2.0:1789607848.677491:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520137856 00000100:00100000:2.0:1789607848.677563:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 183 00000100:00100000:2.0:1789607848.677575:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:11537:x1876539520137856:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789607848.677676:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607848.677902:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386c65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9834 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.677927:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1dab7d300) 00010000:00010000:2.0:1789607848.677934:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607848.677977:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.677997:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.678009:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607848.678336:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000023cba76b reply state 000000005aa72b9b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607848.678347:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789607848.678852:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:11537:x1876539520137856:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 1269us (1495us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789607848.678864:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 183 00010000:00010000:0.0:1789607848.681403:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607848.681484:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607848.681538:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520137984 00000100:00100000:1.0:1789607848.681555:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520137984 00000100:00100000:1.0:1789607848.681643:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 56 00000100:00100000:1.0:1789607848.681655:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520137984:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789607848.682341:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1789607848.682348:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789607848 -> 1789607848 00002000:00010000:1.0:1789607848.682351:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789607846 00002000:00010000:1.0:1789607848.682353:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789607848 -> 1789607848 00002000:00010000:1.0:1789607848.682355:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789607848.682472:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520137984:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 817us (992us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789607848.682482:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 56 00010000:00010000:0.0:1789607848.684859:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.684876:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.684891:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607848.684898:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.684910:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.684933:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1dab7d300) 00010000:00010000:0.0:1789607848.684936:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607848.684943:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.684951:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607848.687186:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607848.687296:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520138240 00000100:00100000:0.0:1789607848.687309:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520138240 00000100:00100000:0.0:1789607848.687387:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 184 00000100:00100000:0.0:1789607848.687401:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:11537:x1876539520138240:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789607848.687541:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.687580:0:6790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386c49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9826 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.687592:0:6790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.687650:0:6790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9826 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.687666:0:6790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386c49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9826 expref: 18 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607848.687684:0:6790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6790:1876539541107328:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607848.687835:0:6790:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607848.694161:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607848.695074:0:6790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6790:1876539541107328:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607848.695114:0:6790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607848.700876:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520138368 00000100:00100000:2.0:1789607848.701007:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520138368 00010000:00010000:0.0:1789607848.701311:0:8517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386c49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9826 expref: 19 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607848.701561:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:3.0:1789607848.701579:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:2373:x1876539520138368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607848.701600:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607848.701610:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386c49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9826 expref: 19 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.701928:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9826 expref: 19 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.701959:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386c49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9826 expref: 19 pid: 5849 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.701980:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1dab7d300) 00010000:00010000:3.0:1789607848.701985:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.701997:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.702005:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.702052:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607848.702134:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:2373:x1876539520138368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 561us (7987us total) trans 0 rc 0/0 00010000:00010000:2.0:1789607848.706582:0:6790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.706603:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.706658:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.706667:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.706695:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.706703:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ade00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607848.706709:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.706728:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.706749:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1dab7d300) 00010000:00010000:2.0:1789607848.706753:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789607848.706759:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.706766:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001386c81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607848.706887:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:11537:x1876539520138240:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 Request processed in 19483us (19708us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789607848.706900:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 184 00000100:00100000:3.0:1789607848.709233:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:3.0:1789607848.725941:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607848.726249:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520138496 00000100:00100000:0.0:1789607848.726264:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520138496 00000100:00100000:0.0:1789607848.726668:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:0.0:1789607848.726694:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520138496:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789607848.727216:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.727253:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9842 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.727264:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607848.727270:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607848.727276:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.727627:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9842 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.727648:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9842 expref: 8 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607848.727669:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876539541107456:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607848.728270:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607848.733048:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876539541107456:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607848.733090:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607848.733299:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607848.733984:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520138624 00000100:00100000:0.0:1789607848.733995:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520138624 00010000:00010000:0.0:1789607848.734051:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9842 expref: 9 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607848.734133:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 70 00000100:00100000:0.0:1789607848.734991:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2374:x1876539520138624:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607848.735016:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607848.735051:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9842 expref: 9 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.735071:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9842 expref: 9 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.735102:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a08b2f11/0x33f091d001386c73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9842 expref: 9 pid: 6695 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.735126:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607848.735131:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607848.735138:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.739560:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.739632:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607848.739762:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520138624:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5608us (6455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607848.739776:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 70 00010000:00010000:2.0:1789607848.739978:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.739991:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.740043:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.740063:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.740074:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.740083:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2aca00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607848.740088:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.740098:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.740123:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.740131:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbe5a9b6/0x33f091d001386c88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607848.740229:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520138496:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 Request processed in 13548us (14302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607848.740239:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:0.0:1789607848.742948:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.743040:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520138880 00000100:00100000:3.0:1789607848.743054:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520138880 00000100:00100000:3.0:1789607848.743162:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 185 00000100:00100000:3.0:1789607848.743175:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+17:11537:x1876539520138880:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789607848.743289:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386c8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.743313:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386c8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.743328:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386c8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.745638:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.745673:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386c57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b982d expref: 18 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.745695:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.745752:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386c57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b982d expref: 18 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.745803:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386c57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b982d expref: 18 pid: 6790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607848.745822:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541107584:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607848.745939:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac840 going to sleep for 11 seconds 00000100:00100000:3.0:1789607848.751917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607848.752048:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541107584:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607848.752089:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607848.753538:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520139008 00000100:00100000:1.0:1789607848.753555:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520139008 00010000:00010000:1.0:1789607848.753618:0:8517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386c57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b982d expref: 19 pid: 6790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607848.753672:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 71 00000100:00100000:1.0:1789607848.753694:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:2373:x1876539520139008:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607848.753717:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607848.753726:0:8517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386c57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b982d expref: 19 pid: 6790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.753742:0:8517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386c57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b982d expref: 19 pid: 6790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.753771:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386c57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b982d expref: 19 pid: 6790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.753791:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1dab7d300) 00010000:00010000:1.0:1789607848.753798:0:8517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.753810:0:8517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.753820:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.753858:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607848.753952:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:2373:x1876539520139008:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 270us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607848.753961:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 71 00010000:00010000:2.0:1789607848.754697:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.754728:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607848.755005:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1789607848.755353:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789607848.755611:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1789607848.755744:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1876539541107712:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789607848.755834:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607848.755871:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e4f36e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607848.756062:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541107712 00000100:00100000:3.0:1789607848.756075:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541107712 00000100:00100000:3.0:1789607848.756297:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789607848.756313:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1876539541107712:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789607848.756457:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1876539541107712:12345-0@lo:1000:mdt00_002.0 Request processed in 148us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607848.756526:0:5849:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789607848.756532:0:5849:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a1e4f4e680, transno 4294967315 00000100:00100000:2.0:1789607848.756551:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1876539541107712:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1789607848.757128:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789607848.757781:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c9d35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1876539541107840:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789607848.757859:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607848.757884:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c97a4840 going to sleep for 11 seconds 00000100:00100000:1.0:1789607848.763082:0:5852:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789607848.763107:0:5852:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789607848.763677:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789607848.763733:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541107840 00000100:00100000:3.0:1789607848.763746:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541107840 00000100:00100000:3.0:1789607848.763789:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607848.763802:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1876539541107840:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789607848.766727:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1876539541107840:12345-0@lo:1000:mdt00_002.0 Request processed in 2911us (8850us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789607848.766749:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607848.768650:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c9d35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5849:1876539541107840:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1789607848.768745:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768760:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768770:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768777:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607848.768783:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768806:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768828:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1dab7d300) 00010000:00010000:2.0:1789607848.768832:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607848.768840:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768846:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386c96 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768889:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386bd2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768896:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386bd2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768902:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386bd2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768906:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607848.768909:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386bd2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768915:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386bd2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768924:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:2.0:1789607848.768926:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607848.768929:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386bd2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768946:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386bd2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768972:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.768990:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9811 expref: 21 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.769000:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.769047:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9811 expref: 21 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.769069:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9811 expref: 21 pid: 6790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607848.769087:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d16300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541107968:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607848.770802:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8db3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789607848.782338:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d16300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541107968:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607848.782586:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607848.785725:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607848.785785:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520139136 00000100:00100000:3.0:1789607848.785800:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520139136 00010000:00010000:3.0:1789607848.785862:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9811 expref: 22 pid: 6790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607848.786672:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 72 00000100:00100000:3.0:1789607848.786711:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:2373:x1876539520139136:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607848.786733:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607848.786742:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9811 expref: 22 pid: 6790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.786759:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9811 expref: 22 pid: 6790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.786789:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3a00/0x33f091d001386bee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9811 expref: 22 pid: 6790 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.786808:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:3.0:1789607848.786815:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.786826:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.786836:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607848.786864:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607848.786935:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:2373:x1876539520139136:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 229us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607848.786944:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 72 00010000:00010000:1.0:1789607848.787025:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787035:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787049:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787056:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787063:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787070:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607848.787075:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787082:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787090:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:1.0:1789607848.787099:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607848.787105:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787111:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386c9d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787123:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386c8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787129:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386c8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787135:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386c8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787140:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558e000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607848.787143:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386c8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787148:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386c8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787155:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790100) 00010000:00010000:1.0:1789607848.787157:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789607848.787159:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386c8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607848.787164:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386c8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607848.787440:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:11537:x1876539520138880:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 44248us (44482us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1789607848.787458:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 185 00000020:00080000:1.0:1789607848.787463:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789607848.788831:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607848.788843:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607848.789882:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1789607848.789902:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789607848.790107:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607848.790229:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520139392 00000100:00100000:1.0:1789607848.790242:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520139392 00000100:00100000:1.0:1789607848.790312:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:1.0:1789607848.790324:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1db76fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:11537:x1876539520139392:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789607848.792055:0:5851:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789607848.792210:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1789607848.792303:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ca4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.792326:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.792341:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ca4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.792361:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ca4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.792385:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ca4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.792393:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ca4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607848.792509:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789607848.792646:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1db76fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:11537:x1876539520139392:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 2318us (2540us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1789607848.792658:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 50 00000020:00080000:2.0:1789607848.792665:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789607848.793660:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607848.793675:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ca4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.793694:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607848.793700:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ca4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.793711:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ca4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.793729:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a1db790500) 00010000:00010000:0.0:1789607848.793733:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789607848.793739:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ca4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.793746:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386ca4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607848.793773:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607848.793774:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607848.793776:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607849.355562:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789607849.438275:0:12525:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607849.439383:0:12525:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607849.439486:0:12525:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789607849.439495:0:12525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789607849.570021:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607849.571639:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520139648 00000100:00100000:2.0:1789607849.571660:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520139648 00000100:00100000:2.0:1789607849.571798:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 186 00000100:00100000:2.0:1789607849.571811:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:11555:x1876539520139648:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607849.571846:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607849.571876:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386cab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9849 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789607849.572087:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789607849.572197:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386cb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.572218:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.572232:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386cb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607849.572269:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789607849.572507:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386cab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9849 expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.572530:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386cb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9849 expref: 24 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.572540:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:2.0:1789607849.572543:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789607849.572548:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3800, rc 0) 00000100:00100000:2.0:1789607849.572633:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11555:x1876539520139648:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 824us (2625us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1789607849.572642:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 186 00000100:00100000:0.0:1789607849.575488:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607849.575589:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520139776 00000100:00100000:3.0:1789607849.575602:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520139776 00000100:00100000:3.0:1789607849.575673:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 187 00000100:00100000:3.0:1789607849.575694:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11555:x1876539520139776:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:3.0:1789607849.575804:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386cc0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.575826:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.575840:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.575860:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386cc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.575868:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.575876:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.576748:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577195:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577209:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607849.577281:0:6790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577297:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386cc0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577304:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386cc0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577312:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577319:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558ee00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607849.577324:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386cc0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577333:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386cc0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577348:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607849.577351:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607849.577357:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386cc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577363:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386cc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577380:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386cc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577386:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386cc7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577400:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577405:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558e000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607849.577407:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386cc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577414:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386cc7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577486:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1c3982e00) 00010000:00010000:3.0:1789607849.577490:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607849.577494:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386cc7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577500:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386cc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577516:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577522:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577529:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577534:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607849.577537:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577552:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577560:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1c3982600) 00010000:00010000:3.0:1789607849.577562:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607849.577565:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.577571:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607849.577690:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11555:x1876539520139776:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 1982us (2762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607849.577701:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 187 00000100:00100000:0.0:1789607849.633904:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607849.635482:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520140032 00000100:00100000:2.0:1789607849.635498:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520140032 00000100:00100000:2.0:1789607849.635585:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 188 00000100:00100000:2.0:1789607849.635599:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11558:x1876539520140032:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607849.636016:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607849.636048:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386cd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9850 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.636160:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386cdc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.636181:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386cdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.636216:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386cdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.636235:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ce3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.636244:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.636251:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.638365:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386cea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.638395:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.638411:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607849.638567:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789607849.639102:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386cdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639118:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386cdc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639126:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386cdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639134:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2e00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607849.639157:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386cdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639168:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386cdc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639186:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:2.0:1789607849.639190:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607849.639197:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386cdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639203:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386cdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639220:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ce3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639227:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ce3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639233:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639238:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607849.639241:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ce3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639247:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ce3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639255:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1db790000) 00010000:00010000:2.0:1789607849.639765:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607849.639780:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ce3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.639789:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ce3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.639933:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386cd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9850 expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.639955:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9850 expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.639964:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790200) 00010000:00010000:3.0:1789607849.639967:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607849.639970:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3c00, rc 0) 00000100:00100000:3.0:1789607849.640069:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:11558:x1876539520140032:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 4472us (6180us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789607849.640079:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 188 00000100:00100000:2.0:1789607849.644369:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607849.645017:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520140160 00000100:00100000:3.0:1789607849.645032:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520140160 00000100:00100000:3.0:1789607849.645121:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 189 00000100:00100000:3.0:1789607849.645135:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:11558:x1876539520140160:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:3.0:1789607849.645236:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.645259:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.645274:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.645310:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.645319:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.645328:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.645334:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607849.645340:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.645349:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.645361:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790200) 00010000:00010000:3.0:1789607849.645365:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789607849.645371:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cf8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.645390:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607849.647780:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:11558:x1876539520140160:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 2617us (3397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607849.647799:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 189 00000100:00100000:1.0:1789607849.661894:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607849.662048:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520140416 00000100:00100000:3.0:1789607849.662064:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520140416 00000100:00100000:3.0:1789607849.662151:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:3.0:1789607849.662164:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:11558:x1876539520140416:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1789607849.662648:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:11558:x1876539520140416:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 483us (767us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789607849.662659:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:0.0:1789607849.737644:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607849.739077:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520140672 00000100:00100000:3.0:1789607849.739100:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520140672 00000100:00100000:3.0:1789607849.739187:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 190 00000100:00100000:3.0:1789607849.739201:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:11092:x1876539520140672:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1789607849.739237:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607849.739266:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cff lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9857 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.739414:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.739449:0:11489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386cea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9850 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.739473:0:11489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.739517:0:11489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9850 expref: 28 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.739534:0:11489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9850 expref: 28 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607849.739551:0:11489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541108096:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607849.739691:0:11489:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607849.745411:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607849.745482:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520140800 00000100:00100000:3.0:1789607849.745494:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520140800 00010000:00010000:3.0:1789607849.745602:0:8517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386cea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9850 expref: 29 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607849.745650:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00100000:3.0:1789607849.745662:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:2374:x1876539520140800:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607849.745691:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607849.745700:0:8517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386cea lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9850 expref: 29 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.745715:0:8517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9850 expref: 29 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.745762:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790200) 00010000:00010000:3.0:1789607849.745768:0:8517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.745779:0:8517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.745788:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.745813:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607849.745882:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:2374:x1876539520140800:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 221us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607849.745890:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 73 00010000:00010000:3.0:1789607849.746046:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386cea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9850 expref: 28 pid: 5849 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607849.746065:0:11489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541108096:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607849.746094:0:11489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.746106:0:11489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.746112:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607849.746135:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789607849.746338:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386cff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9857 expref: 29 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.746354:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9857 expref: 28 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607849.746362:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790200) 00010000:00010000:3.0:1789607849.746365:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789607849.746368:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e000, rc 0) 00000100:00100000:3.0:1789607849.746407:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:11092:x1876539520140672:12345-192.168.202.3@tcp:101:bash.0 Request processed in 7210us (8779us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789607849.746414:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 190 00000100:00100000:1.0:1789607849.757166:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607849.757266:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520141056 00000100:00100000:2.0:1789607849.757281:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520141056 00000100:00100000:2.0:1789607849.757363:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 191 00000100:00100000:2.0:1789607849.757377:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:11092:x1876539520141056:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:2.0:1789607849.757805:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386d14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.757828:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.757843:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607849.757909:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1789607849.758047:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc91653a reply state 00000000b54b9c11 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607849.758060:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789607849.758114:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1789607849.758246:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+32:11092:x1876539520141056:12345-192.168.202.3@tcp:36:bash.0 Request processed in 870us (1094us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1789607849.758255:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 191 00000020:00080000:2.0:1789607849.758260:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789607849.762061:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386d14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607849.762086:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386d14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607849.762095:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386d14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607849.762101:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2e00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607849.762107:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386d14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607849.762117:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386d14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607849.762138:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790200) 00010000:00010000:1.0:1789607849.762162:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607849.762169:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386d14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607849.762176:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386d14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607849.791367:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607849.796282:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520141184 00000100:00100000:3.0:1789607849.796309:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520141184 00000100:00100000:3.0:1789607849.796414:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 192 00000100:00100000:2.0:1789607849.796825:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:11092:x1876539520141184:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607849.796874:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607849.796904:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386d1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b985e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.796981:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386d1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b985e expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.796998:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386d1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b985e expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.797019:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790200) 00010000:00010000:2.0:1789607849.797022:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607849.797028:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e2c00, rc 0) 00000100:00100000:2.0:1789607849.797115:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+32:11092:x1876539520141184:12345-192.168.202.3@tcp:101:bash.0 Request processed in 358us (5770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607849.797123:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 192 00000100:00100000:3.0:1789607849.806548:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607849.806701:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520141312 00000100:00100000:2.0:1789607849.806714:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520141312 00000100:00100000:2.0:1789607849.806791:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:2.0:1789607849.806803:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:11092:x1876539520141312:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607849.806826:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607849.806855:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386d22 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9865 expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789607849.806891:0:8471:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aab3fa8, atime: 0x6aab3fa6, ctime: 0x6aab3fa8, blocks: 0xb 00010000:00010000:2.0:1789607849.807111:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1789607849.807119:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607849.807146:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386d22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9865 expref: 8 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.807167:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386d22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9865 expref: 8 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607849.807183:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3000, rc 0) 00000100:00100000:2.0:1789607849.807254:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:11092:x1876539520141312:12345-192.168.202.3@tcp:101:bash.0 Request processed in 453us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607849.807262:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:3.0:1789607849.811534:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607849.811986:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520141440 00000100:00100000:1.0:1789607849.811999:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520141440 00002000:00010000:1.0:1789607849.812063:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789607849.812068:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1ff39d880 with x1876539520141440 ext(0->18446744073709551615) 00002000:00010000:1.0:1789607849.812087:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1ff39d880. 00000100:00100000:1.0:1789607849.812131:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:1.0:1789607849.812143:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2373:x1876539520141440:12345-192.168.202.3@tcp:10:bash.0 00002000:00010000:1.0:1789607849.812579:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789607849.812585:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789607848 -> 1789607849 00002000:00010000:1.0:1789607849.812589:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789607846 -> 1789607846 00002000:00010000:1.0:1789607849.812591:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789607848 -> 1789607849 00002000:00010000:1.0:1789607849.812594:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789607849.812755:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2373:x1876539520141440:12345-192.168.202.3@tcp:10:bash.0 Request processed in 611us (1233us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789607849.812904:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00002000:00010000:1.0:1789607849.812909:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789607849.812912:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1ff39d880 with x1876539520141440 ext(0->18446744073709551615) 00002000:00010000:1.0:1789607849.812918:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1ff39d880. 00000100:00100000:1.0:1789607850.001395:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.001651:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520141568 00000100:00100000:3.0:1789607850.001666:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520141568 00000100:00100000:3.0:1789607850.001785:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 193 00000100:00100000:3.0:1789607850.001797:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+32:11572:x1876539520141568:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:3.0:1789607850.001915:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002157:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002173:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002219:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002227:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002235:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002580:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002592:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002601:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607850.002654:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002668:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002688:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002698:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002706:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.002711:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002728:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.002744:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607850.002748:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.002756:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.003562:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.003585:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.003593:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.003600:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.003607:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.003662:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.003671:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.003694:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1c3982600) 00010000:00010000:3.0:1789607850.003697:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.003702:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.003726:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.003747:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.003753:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.004263:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.004271:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558ee00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.004275:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.004282:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.004293:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790200) 00010000:00010000:3.0:1789607850.004296:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.004300:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.004306:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607850.004579:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+32:11572:x1876539520141568:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 2776us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607850.004591:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 193 00000100:00100000:0.0:1789607850.088215:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607850.088364:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520141824 00000100:00100000:1.0:1789607850.088390:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520141824 00000100:00100000:1.0:1789607850.088502:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 194 00000100:00100000:1.0:1789607850.088516:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+32:11575:x1876539520141824:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607850.088546:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607850.088575:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386d3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b986c expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.088682:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386d45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.088703:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.088719:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.088739:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386d4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.088748:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.088755:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089134:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386d53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089145:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089153:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386d53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607850.089172:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789607850.089305:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089314:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386d45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089321:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386d45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089328:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eec00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607850.089333:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386d45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089343:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386d45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089358:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:1.0:1789607850.089362:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607850.089368:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386d45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089375:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386d45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089390:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089397:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386d4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089414:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386d4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089473:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efe00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607850.089477:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386d4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089485:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386d4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089494:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1dab7d800) 00010000:00010000:1.0:1789607850.089497:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607850.089501:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386d4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089508:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386d4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089563:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386d3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b986c expref: 35 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089580:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386d53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b986c expref: 34 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.089589:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790200) 00010000:00010000:1.0:1789607850.089592:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789607850.089595:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef200, rc 0) 00000100:00100000:1.0:1789607850.089688:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:11575:x1876539520141824:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1174us (1488us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789607850.089707:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 194 00000100:00100000:0.0:1789607850.097119:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607850.097205:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520141952 00000100:00100000:2.0:1789607850.097221:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520141952 00000100:00100000:2.0:1789607850.097533:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 195 00000100:00100000:2.0:1789607850.097547:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:11575:x1876539520141952:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:2.0:1789607850.097639:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.097661:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9857 expref: 34 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.097683:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.097734:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9857 expref: 34 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.097751:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9857 expref: 34 pid: 11489 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607850.097799:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541108224:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607850.097956:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607850.107586:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541108224:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607850.107631:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.118136:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607850.118388:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520142208 00000100:00100000:2.0:1789607850.118402:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520142208 00000100:00100000:2.0:1789607850.119090:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:2.0:1789607850.119105:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:5614:x1876539520142208:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789607850.119612:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:5614:x1876539520142208:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 509us (1489us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789607850.119622:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:3.0:1789607850.132344:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607850.132521:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520142336 00000100:00100000:0.0:1789607850.132536:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520142336 00010000:00010000:0.0:1789607850.132591:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9857 expref: 36 pid: 11489 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.132642:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 74 00000100:00100000:0.0:1789607850.132653:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:2374:x1876539520142336:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607850.132682:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607850.132691:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9857 expref: 36 pid: 11489 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.132707:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9857 expref: 36 pid: 11489 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.132733:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386d06 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9857 expref: 36 pid: 11489 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.132754:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790200) 00010000:00010000:0.0:1789607850.132774:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.132786:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.132796:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.132832:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607850.132908:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:2374:x1876539520142336:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 256us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607850.133147:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 74 00010000:00010000:2.0:1789607850.133259:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.133392:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.134385:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.134401:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.134409:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.134558:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607850.134563:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.134572:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.134591:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790200) 00010000:00010000:2.0:1789607850.134594:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607850.134600:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.134607:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386d61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607850.134854:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:11575:x1876539520141952:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 37305us (37755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607850.134865:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 195 00000100:00100000:1.0:1789607850.140653:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.141020:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520142592 00000100:00100000:3.0:1789607850.141034:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520142592 00000100:00100000:3.0:1789607850.141106:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:3.0:1789607850.141118:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+34:11575:x1876539520142592:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:3.0:1789607850.144056:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:11575:x1876539520142592:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 2924us (3404us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789607850.144071:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:0.0:1789607850.221250:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.221619:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520142848 00000100:00100000:3.0:1789607850.221633:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520142848 00000100:00100000:3.0:1789607850.221726:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 196 00000100:00100000:3.0:1789607850.221742:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+35:11586:x1876539520142848:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:3.0:1789607850.221787:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607850.221817:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9873 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.222078:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.222097:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.222114:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.222133:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.222141:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.222170:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.222746:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386d7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.223504:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.223522:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386d7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607850.223539:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789607850.223696:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.223706:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.223714:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.223721:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.223726:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.223735:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.223750:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607850.223753:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.224069:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.224077:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386d6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.224096:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.224103:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.224109:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.224114:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.224116:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.224122:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.224130:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1c3982600) 00010000:00010000:3.0:1789607850.224133:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.224136:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.224141:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386d76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.224209:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386d68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9873 expref: 38 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.224237:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386d7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9873 expref: 37 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.224246:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790200) 00010000:00010000:3.0:1789607850.224248:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607850.224251:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f000, rc 0) 00000100:00100000:3.0:1789607850.224595:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:11586:x1876539520142848:12345-192.168.202.3@tcp:101:cat.0 Request processed in 2856us (3362us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789607850.224607:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 196 00000100:00100000:0.0:1789607850.234320:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607850.234398:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520143104 00000100:00100000:2.0:1789607850.234464:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520143104 00000100:00100000:2.0:1789607850.234544:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00100000:2.0:1789607850.234557:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:11586:x1876539520143104:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1789607850.234924:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11586:x1876539520143104:12345-192.168.202.3@tcp:35:cat.0 Request processed in 368us (619us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789607850.234932:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00100000:1.0:1789607850.258917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607850.259138:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520143360 00000100:00100000:0.0:1789607850.259152:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520143360 00000100:00100000:0.0:1789607850.259239:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 197 00000100:00100000:0.0:1789607850.259253:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11587:x1876539520143360:12345-192.168.202.3@tcp:36:rm.0 00010000:00010000:0.0:1789607850.259367:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789607850.259405:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386d7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9873 expref: 38 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.259472:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef200/0x33f091d001386d53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b986c expref: 37 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.259490:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386d1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b985e expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.259501:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1db790200) 00010000:00010000:0.0:1789607850.259515:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607850.259543:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386d8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.259560:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386d8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.259571:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386d8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.259620:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386d92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.259629:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386d92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.259637:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386d92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.260260:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386d99 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.260272:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386d99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.260280:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386d99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607850.261778:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1789607850.261796:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 384106372803ns, next at 385106369155ns, rc = 0 00010000:00010000:0.0:1789607850.261970:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386da0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262478:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386da0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262493:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386da0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262506:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386da0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262532:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386da0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262539:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386da0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262658:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607850.262696:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386d99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262704:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386d99 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262711:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386d99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262719:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607850.262724:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386d99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262734:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386d99 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262749:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:0.0:1789607850.262753:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789607850.262759:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386d99 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262766:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386d99 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262794:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386d8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262807:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386d8b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262813:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386d8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262819:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ad600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607850.262823:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386d8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262829:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386d8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262847:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:0.0:1789607850.262849:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607850.262853:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386d8b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.262859:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386d8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607850.262871:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5bc35b3 reply state 00000000d32de79b transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386d92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.262882:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789607850.263414:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+37:11587:x1876539520143360:12345-192.168.202.3@tcp:36:rm.0 Request processed in 4157us (4506us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789607850.263461:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 197 00010000:00010000:1.0:1789607850.264506:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607850.264520:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386da0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.264531:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ace00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607850.264535:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386da0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.264547:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386da0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.264565:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:1.0:1789607850.264568:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789607850.264572:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386da0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.264579:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ace00/0x33f091d001386da0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.264677:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607850.264681:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607850.264683:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607850.267477:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386d92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.267503:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386d92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.267513:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386d92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.267521:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.267527:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386d92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.267537:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386d92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.267558:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1f911da00) 00010000:00010000:3.0:1789607850.267561:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.267568:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386d92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.267595:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d001386d92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607850.326753:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607850.327053:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520143616 00000100:00100000:2.0:1789607850.327078:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520143616 00000100:00100000:2.0:1789607850.327161:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 198 00000100:00100000:2.0:1789607850.327192:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+36:11594:x1876539520143616:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607850.327230:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607850.327261:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386da7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b987a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.327587:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386dae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.327610:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386dae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.327625:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386dae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.327645:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386db5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.327652:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386db5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.327659:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386db5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789607850.328378:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789607850.329021:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386dbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.329043:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.329055:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386dbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.329117:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386dae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.329126:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386dae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.329135:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386dae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.329142:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607850.329147:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386dae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.329156:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386dae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.329171:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:2.0:1789607850.329174:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607850.329182:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386dae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.329190:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386dae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607850.329208:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcb4b751 reply state 000000009058b299 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386db5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607850.329218:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789607850.329261:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386da7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b987a expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.329302:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b987a expref: 38 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.329310:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1db790400) 00010000:00010000:2.0:1789607850.329313:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607850.329315:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3c00, rc 0) 00000100:00100000:2.0:1789607850.330796:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+39:11594:x1876539520143616:12345-192.168.202.3@tcp:101:bash.0 Request processed in 3596us (4048us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789607850.330811:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 198 00010000:00010000:1.0:1789607850.333402:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386db5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.333667:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386db5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.333991:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386db5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.334000:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2e00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607850.334006:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386db5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.334017:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386db5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.334040:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1db790b00) 00010000:00010000:1.0:1789607850.334044:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607850.334050:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386db5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.334058:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386db5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.334594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607850.334883:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520143744 00000100:00100000:2.0:1789607850.334896:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520143744 00000100:00100000:2.0:1789607850.335030:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:2.0:1789607850.335044:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2373:x1876539520143744:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607850.335069:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607850.335094:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001d76e88/0x33f091d001386dca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9881 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789607850.335128:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607850.335155:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=384s v=(0 0) 00010000:00010000:2.0:1789607850.335162:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607850.335172:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001d76e88/0x33f091d001386dca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9881 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.335194:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001d76e88/0x33f091d001386dca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9881 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.335229:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3400, rc 0) 00000100:00100000:2.0:1789607850.335599:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2373:x1876539520143744:12345-192.168.202.3@tcp:101:bash.0 Request processed in 556us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607850.335609:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00080000:3.0:1789607850.335743:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607850.340246:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607850.341008:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520143872 00000100:00100000:1.0:1789607850.341022:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520143872 00000100:00100000:1.0:1789607850.341096:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:1.0:1789607850.341105:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:11594:x1876539520143872:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:1.0:1789607850.341127:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607850.341148:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9888 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.341187:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001d76e88/0x33f091d001386dca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9881 expref: 9 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.341207:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607850.341211:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607850.341216:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 9 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.341252:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001d76e88/0x33f091d001386dca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9881 expref: 9 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.341264:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001d76e88/0x33f091d001386dca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9881 expref: 9 pid: 6694 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607850.341918:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee290000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1876539541108352:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607850.342049:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607850.345205:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee290000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1876539541108352:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607850.345264:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 9 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.345307:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef000, rc 0) 00000100:00100000:1.0:1789607850.345392:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:11594:x1876539520143872:12345-192.168.202.3@tcp:101:bash.0 Request processed in 4286us (5160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607850.345403:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:0.0:1789607850.348171:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.348774:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520144000 00000100:00100000:3.0:1789607850.348788:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520144000 00010000:00010000:3.0:1789607850.348845:0:8517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001d76e88/0x33f091d001386dca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9881 expref: 9 pid: 6694 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607850.348945:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:3.0:1789607850.348955:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2374:x1876539520144000:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607850.348972:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607850.349010:0:8517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001d76e88/0x33f091d001386dca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9881 expref: 9 pid: 6694 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.349024:0:8517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001d76e88/0x33f091d001386dca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9881 expref: 9 pid: 6694 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.349049:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001d76e88/0x33f091d001386dca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9881 expref: 9 pid: 6694 timeout: 484 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.349070:0:8517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607850.349075:0:8517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607850.349086:0:8517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.349121:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.349170:0:8517:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607850.349187:0:8517:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201655880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8517:1876539541108480:192.168.202.3@tcp:105: 00000100:00100000:3.0:1789607850.349295:0:8517:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20ac900 going to sleep for 11 seconds 00000100:00100000:0.0:1789607850.353962:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.354120:0:8517:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201655880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8517:1876539541108480:192.168.202.3@tcp:105: 00010000:00010000:3.0:1789607850.354152:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607850.354220:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520144000:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 5264us (6065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607850.354234:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:1.0:1789607850.354599:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520144256 00000100:00100000:1.0:1789607850.354610:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520144256 00000100:00100000:1.0:1789607850.354771:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:1.0:1789607850.354802:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+38:11594:x1876539520144256:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:1.0:1789607850.355236:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+39:11594:x1876539520144256:12345-192.168.202.3@tcp:35:bash.0 Request processed in 435us (1289us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789607850.355244:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 55 00010000:00010000:3.0:1789607850.379631:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607850.554864:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.555017:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520144384 00000100:00100000:3.0:1789607850.555032:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520144384 00000100:00100000:3.0:1789607850.555117:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 199 00000100:00100000:3.0:1789607850.555130:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+39:11610:x1876539520144384:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607850.555165:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607850.555197:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386dd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b988f expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.555292:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386ddf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.555329:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386ddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.555345:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386ddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607850.555405:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789607850.555411:0:11489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607850.555477:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386ddf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.555523:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386dd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b988f expref: 41 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.555546:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386ddf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b988f expref: 40 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.555555:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607850.555558:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607850.555563:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f800, rc 0) 00000100:00100000:3.0:1789607850.555652:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+40:11610:x1876539520144384:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 523us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607850.555660:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 199 00000100:00100000:0.0:1789607850.562197:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.562364:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520144640 00000100:00100000:3.0:1789607850.562379:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520144640 00000100:00100000:3.0:1789607850.562554:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 200 00000100:00100000:3.0:1789607850.562568:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+40:11610:x1876539520144640:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607850.562598:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607850.562645:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386de6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9896 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.562803:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ded lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.562832:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.562853:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607850.562870:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789607850.563188:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386de6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9896 expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.563215:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9896 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.563224:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1db790400) 00010000:00010000:3.0:1789607850.563227:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607850.563232:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558fc00, rc 0) 00000100:00100000:3.0:1789607850.563318:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+42:11610:x1876539520144640:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 753us (1136us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1789607850.563327:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 200 00000100:00100000:0.0:1789607850.566913:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.567202:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520144768 00000100:00100000:3.0:1789607850.567332:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520144768 00000100:00100000:3.0:1789607850.567557:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:3.0:1789607850.567569:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+42:2374:x1876539520144768:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607850.567620:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607850.567654:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ded lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9896 expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.567785:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1db790400) 00010000:00010000:3.0:1789607850.567793:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607850.568233:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+41:2374:x1876539520144768:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 663us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607850.568245:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:0.0:1789607850.568508:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.568751:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520145024 00000100:00100000:3.0:1789607850.568761:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520145024 00000100:00100000:3.0:1789607850.568803:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 201 00000100:00100000:3.0:1789607850.568810:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+41:11610:x1876539520145024:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607850.569183:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607850.569211:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386dfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b989d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.569350:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.569371:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.569386:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607850.570058:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789607850.570242:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386dfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b989d expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.570283:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b989d expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.570292:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1db790400) 00010000:00010000:3.0:1789607850.570296:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789607850.570299:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e000, rc 0) 00000100:00100000:3.0:1789607850.570386:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+43:11610:x1876539520145024:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1574us (1877us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789607850.570682:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 201 00000100:00100000:0.0:1789607850.576797:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607850.578830:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520145152 00000100:00100000:2.0:1789607850.578853:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520145152 00000100:00100000:2.0:1789607850.578975:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:2.0:1789607850.578990:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2376:x1876539520145152:12345-192.168.202.3@tcp:1:lfs.0 00010000:00010000:2.0:1789607850.579058:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.579086:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.579096:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607850.579102:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607850.579107:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.579158:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.579175:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 8 pid: 6692 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607850.579230:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8dc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876539541108608:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607850.579645:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607850.587607:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607850.590034:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8dc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6695:1876539541108608:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607850.590084:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607850.592493:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520145280 00000100:00100000:3.0:1789607850.592512:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520145280 00002000:00100000:3.0:1789607850.592595:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99a1ff419180 x1876539520145280/t0(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:406/0 lens 504/0 e 0 to 0 dl 1789607861 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789607850.592609:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1ff419180 with x1876539520145280 ext(0->8) 00010000:00010000:3.0:1789607850.592621:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 9 pid: 6692 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.592641:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 9 pid: 6692 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789607850.592651:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99a1ff419180 00000100:00100000:3.0:1789607850.592756:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:3.0:1789607850.592768:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2373:x1876539520145280:12345-192.168.202.3@tcp:4:lfs.0 00000100:00100000:2.0:1789607850.595205:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:2373:x1876539520145280:12345-192.168.202.3@tcp:4:lfs.0 Request processed in 2422us (7598us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789607850.595223:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00002000:00100000:2.0:1789607850.595239:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99a1ff419180 x1876539520145280/t4294967308(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:406/0 lens 504/448 e 0 to 0 dl 1789607861 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789607850.595251:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1ff419180 with x1876539520145280 ext(0->8) 00010000:00010000:2.0:1789607850.595265:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 11 pid: 6692 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.595291:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 11 pid: 6692 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789607850.595301:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff99a1ff419180 00000100:00100000:3.0:1789607850.598483:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607850.598621:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520145408 00000100:00100000:0.0:1789607850.598635:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520145408 00010000:00010000:0.0:1789607850.598702:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 11 pid: 6692 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.598758:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:0.0:1789607850.598771:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:2375:x1876539520145408:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607850.598791:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789607850.598820:0:5834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789607850.598824:0:5834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789607850 00002000:00010000:0.0:1789607850.598827:0:5834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789607850 00002000:00010000:0.0:1789607850.598829:0:5834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789607850 00010000:00010000:0.0:1789607850.598850:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 11 pid: 6692 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.598874:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 11 pid: 6692 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.598905:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001386dd1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9888 expref: 11 pid: 6692 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.599020:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607850.599026:0:5834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607850.599034:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.599047:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.599096:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607850.599169:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:2375:x1876539520145408:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 399us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607850.599177:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 76 00010000:00010000:1.0:1789607850.599466:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.599477:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.599509:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.599518:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.599527:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.599534:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607850.599539:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.599549:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.599577:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.599586:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7cf5abe/0x33f091d001386e10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607850.599656:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2376:x1876539520145152:12345-192.168.202.3@tcp:1:lfs.0 Request processed in 20670us (22875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607850.599665:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:3.0:1789607850.602940:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607850.603243:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520145664 00000100:00100000:0.0:1789607850.603257:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520145664 00000100:00100000:0.0:1789607850.603331:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 56 00000100:00100000:0.0:1789607850.603344:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1db76f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+43:11610:x1876539520145664:12345-192.168.202.3@tcp:35:lfs.0 00000004:00010000:0.0:1789607850.603468:0:12083:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b989d expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607850.604177:0:12083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1789607850.604232:0:12083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1789607850.606263:0:12083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1789607850.606381:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.606406:0:12083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386dbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b987a expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.607145:0:12083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.607204:0:12083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b987a expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.607225:0:12083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386dbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b987a expref: 47 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.607245:0:12083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff418e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12083:1876539541108736:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607850.607464:0:12083:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607850.615170:0:12083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff418e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:12083:1876539541108736:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607850.615217:0:12083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607850.615623:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607850.616192:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520145792 00000100:00100000:0.0:1789607850.616204:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520145792 00010000:00010000:0.0:1789607850.616256:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386dbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b987a expref: 48 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.616308:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:0.0:1789607850.616320:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201655880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+48:2373:x1876539520145792:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607850.616344:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607850.616353:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386dbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b987a expref: 48 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.616369:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386dbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b987a expref: 48 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.616396:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386dbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b987a expref: 48 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.617094:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1db790400) 00010000:00010000:0.0:1789607850.617101:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.617114:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.617124:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.617161:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607850.617193:0:12083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.617201:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.617247:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201655880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+47:2373:x1876539520145792:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 926us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607850.617257:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 77 00000001:00080000:3.0:1789607850.617383:0:12083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789607850.617644:0:12083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1789607850.617784:0:12083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201657100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12083:1876539541108864:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1789607850.617858:0:12083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607850.617949:0:12083:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607850.618792:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541108864 00000100:00100000:1.0:1789607850.618804:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541108864 00000100:00100000:1.0:1789607850.618923:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607850.618934:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:12083:x1876539541108864:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789607850.619053:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201657800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:12083:x1876539541108864:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 121us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607850.619059:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789607850.619185:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607850.619197:0:12083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201657100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12083:1876539541108864:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1789607850.620175:0:12083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1789607850.620282:0:12083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff41aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12083:1876539541108992:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789607850.620367:0:12083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607850.620408:0:12083:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a780 going to sleep for 11 seconds 00000100:00100000:3.0:1789607850.620509:0:12495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541108992 00000100:00100000:3.0:1789607850.620518:0:12495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541108992 00000100:00100000:3.0:1789607850.620591:0:12495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607850.620598:0:12495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:12083:x1876539541108992:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1789607850.620839:0:12495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:12083:x1876539541108992:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 241us (473us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789607850.620845:0:12495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789607850.621159:0:12083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff41aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:12083:1876539541108992:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1789607850.621233:0:12083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1789607850.621281:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.621295:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.621319:0:12083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.621326:0:12083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2aca00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607850.621332:0:12083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.621341:0:12083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.621362:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1db790400) 00010000:00010000:0.0:1789607850.621365:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789607850.621371:0:12083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.621378:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789607850.621656:0:12083:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789607850.621820:0:12083:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1789607850.621833:0:12083:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 384466410005ns, next at 385466407413ns, rc = 0 00000001:00080000:0.0:1789607850.621849:0:12083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1789607850.623398:0:12083:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1db790400) 00010000:00010000:0.0:1789607850.623410:0:12083:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789607850.623437:0:12083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b989d expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.623621:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1db76f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+50:11610:x1876539520145664:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 20277us (20699us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1789607850.623654:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 56 00000020:00080000:0.0:1789607850.623662:0:12083:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789607850.625194:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607850.625517:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520145920 00000100:00100000:0.0:1789607850.625527:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520145920 00000100:00100000:0.0:1789607850.625577:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 202 00000100:00100000:0.0:1789607850.625585:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+50:11610:x1876539520145920:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:0.0:1789607850.625618:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607850.625642:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac200/0x33f091d001386e1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98a4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.625720:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac200/0x33f091d001386e1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98a4 expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.625738:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac200/0x33f091d001386e1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98a4 expref: 51 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.625762:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:0.0:1789607850.625765:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607850.625769:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ac200, rc 0) 00000100:00100000:0.0:1789607850.625863:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201655c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+51:11610:x1876539520145920:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 278us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607850.625868:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 202 00000100:00100000:3.0:1789607850.631017:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607850.631181:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520146176 00000100:00100000:1.0:1789607850.631195:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520146176 00000100:00100000:1.0:1789607850.631269:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:1.0:1789607850.631283:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+51:11610:x1876539520146176:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1789607850.631694:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201656d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+52:11610:x1876539520146176:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 412us (690us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1789607850.631703:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:2.0:1789607850.704560:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.704843:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520146304 00000100:00100000:3.0:1789607850.704857:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520146304 00000100:00100000:3.0:1789607850.705324:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 203 00000100:00100000:3.0:1789607850.705341:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+52:11620:x1876539520146304:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:3.0:1789607850.705504:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705529:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705544:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705563:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705571:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705578:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705732:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705742:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705750:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789607850.705821:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705836:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705853:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705861:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705869:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.705874:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705883:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705898:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607850.705902:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.705908:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705915:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705944:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705951:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705958:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705963:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.705990:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.705996:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.706004:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1c3982e00) 00010000:00010000:3.0:1789607850.706007:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.706010:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.706015:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.706031:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.706037:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.706042:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.706047:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558ee00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.706050:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.706055:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.706062:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607850.706064:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.706073:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.706078:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607850.706184:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+52:11620:x1876539520146304:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 846us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607850.706192:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 203 00000100:00100000:2.0:1789607850.735789:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.735885:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520146560 00000100:00100000:3.0:1789607850.735898:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520146560 00000100:00100000:3.0:1789607850.736187:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 204 00000100:00100000:3.0:1789607850.736203:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff81a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+52:11623:x1876539520146560:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607850.736233:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607850.736261:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98ab expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736352:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e41 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736371:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736386:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736403:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736411:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736470:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736778:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736788:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736797:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607850.736808:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789607850.736934:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736943:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736950:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736957:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.736962:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736972:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.736995:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607850.736998:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.737011:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.737018:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386e41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.737035:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.737041:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.737047:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.737052:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.737055:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.737060:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.737068:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1c3982e00) 00010000:00010000:3.0:1789607850.737071:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.737074:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.737080:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.737128:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ab expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.737155:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ab expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.737164:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607850.737166:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607850.737169:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e000, rc 0) 00000100:00100000:3.0:1789607850.737294:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff81a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+54:11623:x1876539520146560:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1094us (1519us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789607850.737302:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 204 00000100:00100000:1.0:1789607850.742703:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607850.743134:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520146688 00000100:00100000:0.0:1789607850.743148:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520146688 00000100:00100000:0.0:1789607850.743266:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 205 00000100:00100000:0.0:1789607850.743280:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+54:11623:x1876539520146688:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:0.0:1789607850.743398:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.743444:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.743461:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.743499:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.743507:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.743515:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.743521:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2aca00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607850.743525:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.743534:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.743547:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:0.0:1789607850.743551:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607850.743557:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.743565:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386e5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.743755:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+54:11623:x1876539520146688:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 476us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607850.743763:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 205 00000100:00100000:2.0:1789607850.746234:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607850.746311:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520146944 00000100:00100000:0.0:1789607850.746323:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520146944 00000100:00100000:0.0:1789607850.746467:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:0.0:1789607850.746480:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+54:11623:x1876539520146944:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:0.0:1789607850.746783:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:11623:x1876539520146944:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 305us (561us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789607850.746791:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:2.0:1789607850.800518:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607850.800598:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607850.800647:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607850.800833:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520147328 00000100:00100000:0.0:1789607850.800846:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520147328 00000100:00100000:0.0:1789607850.800933:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 160 00000100:00100000:0.0:1789607850.800948:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520147328:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607850.801048:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520147328:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 105us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607850.801057:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 160 00000100:00100000:3.0:1789607850.801140:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520147072 00000100:00100000:3.0:1789607850.801145:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520147072 00000100:00100000:3.0:1789607850.801189:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 298 00000100:00100000:3.0:1789607850.801197:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2374:x1876539520147072:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607850.801232:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2374:x1876539520147072:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 31us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607850.801239:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 298 00000100:00100000:1.0:1789607850.801479:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520147200 00000100:00100000:1.0:1789607850.801485:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520147200 00000100:00100000:1.0:1789607850.801519:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 92 00000100:00100000:1.0:1789607850.801525:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2374:x1876539520147200:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607850.801557:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2374:x1876539520147200:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 32us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607850.801564:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 92 00000100:00080000:2.0:1789607850.802168:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607850.802174:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607850.820217:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607850.821068:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520147584 00000100:00100000:2.0:1789607850.821087:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520147584 00000100:00100000:2.0:1789607850.821174:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 206 00000100:00100000:2.0:1789607850.821188:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:11633:x1876539520147584:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607850.821225:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607850.821229:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789607850.821266:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386ddf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b988f expref: 55 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.821290:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:2.0:1789607850.821297:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607850.821315:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386e64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98b2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.821545:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.821564:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ab expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.821573:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.822089:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ab expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.822123:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ab expref: 55 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607850.822141:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c527fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541109120:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607850.822314:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607850.826488:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607850.827033:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520147712 00000100:00100000:0.0:1789607850.827047:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520147712 00010000:00010000:0.0:1789607850.827106:0:5834:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e4f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ab expref: 56 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.827161:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:0.0:1789607850.827173:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+56:2373:x1876539520147712:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607850.827195:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607850.827211:0:5834:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e4f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ab expref: 56 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.827226:0:5834:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ab expref: 56 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.827253:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:0.0:1789607850.827260:0:5834:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.827272:0:5834:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.827281:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607850.827305:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607850.827388:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+56:2373:x1876539520147712:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 216us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607850.827396:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 78 00010000:00010000:3.0:1789607850.828752:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ab expref: 55 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607850.828781:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c527fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5848:1876539541109120:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607850.828811:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.828822:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.828842:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607850.828868:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789607850.829073:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2800/0x33f091d001386e64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b2 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.829091:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b2 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.829100:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607850.829103:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789607850.829107:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3200, rc 0) 00000100:00100000:3.0:1789607850.829180:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201655f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:11633:x1876539520147584:12345-192.168.202.3@tcp:101:bash.0 Request processed in 7995us (8978us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789607850.829190:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 206 00000100:00100000:0.0:1789607850.832386:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607850.832584:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520147968 00000100:00100000:1.0:1789607850.832597:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520147968 00000100:00100000:1.0:1789607850.832688:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 207 00000100:00100000:1.0:1789607850.832700:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+55:11633:x1876539520147968:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:1.0:1789607850.833069:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386e79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.833090:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.833104:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789607850.833167:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1789607850.833192:0:5849:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c7567bae reply state 000000000a8ab002 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607850.833202:0:5849:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607850.833323:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+58:11633:x1876539520147968:12345-192.168.202.3@tcp:36:bash.0 Request processed in 623us (950us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789607850.833331:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 207 00000020:00080000:1.0:1789607850.833338:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789607850.836505:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386e79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.836528:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386e79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.836537:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386e79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.836543:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.836549:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386e79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.836586:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386e79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.836617:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607850.836621:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.836628:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386e79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.836635:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001386e79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.838296:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607850.838765:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520148096 00000100:00100000:1.0:1789607850.838779:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520148096 00000100:00100000:1.0:1789607850.838853:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 208 00000100:00100000:1.0:1789607850.838867:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+57:11633:x1876539520148096:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:1.0:1789607850.838895:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607850.838925:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d001386e80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98b9 expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.839227:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.839247:0:6790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b2 expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.839258:0:6790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.839301:0:6790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b2 expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.839317:0:6790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b2 expref: 58 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607850.839336:0:6790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee293b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6790:1876539541109248:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607850.839683:0:6790:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607850.842885:0:6790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee293b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6790:1876539541109248:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607850.842997:0:6790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607850.845271:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607850.845660:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520148224 00000100:00100000:1.0:1789607850.845683:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520148224 00010000:00010000:1.0:1789607850.845845:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b2 expref: 59 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607850.845922:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:1.0:1789607850.845934:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+59:2374:x1876539520148224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607850.845954:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607850.845963:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b2 expref: 59 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.845987:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b2 expref: 59 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.846016:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3200/0x33f091d001386e6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b2 expref: 59 pid: 5848 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.846036:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:1.0:1789607850.846043:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.846054:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.846062:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.846201:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607850.846285:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+58:2374:x1876539520148224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 353us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607850.846293:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 79 00010000:00010000:2.0:1789607850.847762:0:6790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.847781:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607850.847852:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789607850.847858:0:6790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607850.847885:0:6790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.847937:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee400/0x33f091d001386e80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b9 expref: 58 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.847962:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b9 expref: 57 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.848144:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:2.0:1789607850.848148:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607850.848152:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4efc00, rc 0) 00000100:00100000:2.0:1789607850.848231:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+57:11633:x1876539520148096:12345-192.168.202.3@tcp:101:bash.0 Request processed in 9367us (9948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607850.848241:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 208 00000100:00100000:0.0:1789607850.851690:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607850.851877:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520148480 00000100:00100000:2.0:1789607850.851891:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520148480 00000100:00100000:2.0:1789607850.852043:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:2.0:1789607850.852057:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+57:11633:x1876539520148480:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:2.0:1789607850.852533:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+58:11633:x1876539520148480:12345-192.168.202.3@tcp:35:bash.0 Request processed in 477us (868us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789607850.852543:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:1.0:1789607850.906018:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.906235:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520148608 00000100:00100000:3.0:1789607850.906249:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520148608 00000100:00100000:3.0:1789607850.906327:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 209 00000100:00100000:3.0:1789607850.906340:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+58:11639:x1876539520148608:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607850.906374:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607850.906403:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.906571:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.906591:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.906605:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607850.906653:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789607850.906658:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607850.906705:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.906739:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558e000/0x33f091d001386e8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98c0 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.906761:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98c0 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.906770:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607850.906774:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607850.906779:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558ee00, rc 0) 00000100:00100000:3.0:1789607850.906856:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+59:11639:x1876539520148608:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 518us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607850.906864:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 209 00000100:00100000:0.0:1789607850.912275:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.912470:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520148736 00000100:00100000:3.0:1789607850.912485:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520148736 00000100:00100000:3.0:1789607850.912615:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 210 00000100:00100000:3.0:1789607850.912629:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+59:11639:x1876539520148736:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607850.912660:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607850.912698:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98c7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.912785:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ea3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.912803:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.912818:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.912856:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386eaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.912863:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.912870:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913008:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386eb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913019:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913027:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607850.913077:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789607850.913082:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607850.913106:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913119:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913128:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ea3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913135:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ea3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913152:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913159:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.913164:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ea3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913173:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ea3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913186:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:3.0:1789607850.913190:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.913196:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ea3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913203:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fc00/0x33f091d001386ea3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913218:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386eaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913225:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386eaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913231:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386eaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913236:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607850.913239:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386eaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913256:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386eaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913264:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1c3982e00) 00010000:00010000:3.0:1789607850.913266:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607850.913270:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386eaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913276:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386eaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913313:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386e9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98c7 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913328:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98c7 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.913337:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607850.913339:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607850.913342:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c0030a00, rc 0) 00000100:00100000:3.0:1789607850.913766:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+60:11639:x1876539520148736:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1128us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607850.913777:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 210 00000100:00100000:0.0:1789607850.922215:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607850.922319:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.922481:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520149120 00000100:00100000:3.0:1789607850.922496:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520149120 00000100:00100000:3.0:1789607850.922589:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:3.0:1789607850.922604:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+60:2376:x1876539520149120:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607850.922649:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607850.922697:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386eb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98c7 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.922723:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607850.922730:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607850.922808:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+59:2376:x1876539520149120:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 208us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607850.922816:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:2.0:1789607850.924465:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520148992 00000100:00100000:2.0:1789607850.924483:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520148992 00000100:00100000:2.0:1789607850.924555:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 211 00000100:00100000:2.0:1789607850.924567:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+59:11639:x1876539520148992:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607850.924597:0:6790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607850.924638:0:6790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386eb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98ce expref: -99 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.924791:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.924810:0:6790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b9 expref: 60 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.924838:0:6790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.924885:0:6790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b9 expref: 60 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.924901:0:6790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b9 expref: 60 pid: 6790 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607850.925041:0:6790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1facd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6790:1876539541109376:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607850.925174:0:6790:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607850.929528:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.929897:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520149248 00000100:00100000:3.0:1789607850.929910:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520149248 00010000:00010000:3.0:1789607850.930085:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b9 expref: 61 pid: 6790 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607850.930191:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:3.0:1789607850.930204:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:2373:x1876539520149248:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607850.930223:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607850.930231:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b9 expref: 61 pid: 6790 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.930246:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b9 expref: 61 pid: 6790 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.930274:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607850.930281:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.930315:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.930324:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.930364:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607850.930466:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d66050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:2373:x1876539520149248:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 264us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607850.930474:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 80 00010000:00010000:2.0:1789607850.931595:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d001386e87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98b9 expref: 60 pid: 6790 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607850.931632:0:6790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1facd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6790:1876539541109376:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607850.931680:0:6790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.931693:0:6790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.931700:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607850.931726:0:6790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789607850.932406:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2200/0x33f091d001386eb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ce expref: 61 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.932488:0:6790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ce expref: 60 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607850.932498:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:2.0:1789607850.932501:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789607850.932505:0:6790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3400, rc 0) 00000100:00100000:2.0:1789607850.932593:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+60:11639:x1876539520148992:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 8028us (10390us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789607850.932616:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 211 00000100:00100000:0.0:1789607850.938681:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.938800:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520149504 00000100:00100000:3.0:1789607850.938816:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520149504 00000100:00100000:3.0:1789607850.939023:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:3.0:1789607850.939038:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+60:11639:x1876539520149504:12345-192.168.202.3@tcp:103:lfs.0 00010000:00010000:3.0:1789607850.939062:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607850.939095:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac200/0x33f091d001386e1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98a4 expref: 60 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.939123:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607850.939130:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607850.939211:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+59:11639:x1876539520149504:12345-192.168.202.3@tcp:103:lfs.0 Request processed in 177us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607850.939219:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:0.0:1789607850.949877:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607850.950170:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520149632 00000100:00100000:1.0:1789607850.950186:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520149632 00000100:00100000:1.0:1789607850.950552:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 212 00000100:00100000:1.0:1789607850.950567:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+59:11639:x1876539520149632:12345-192.168.202.3@tcp:58:lfs.0 00010000:00010000:1.0:1789607850.950752:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386ecd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.950777:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607850.950793:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789607850.951210:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789607850.951867:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+59:11639:x1876539520149632:12345-192.168.202.3@tcp:58:lfs.0 Request processed in 1297us (2002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607850.951881:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 212 00000100:00100000:0.0:1789607850.956209:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607850.956495:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520149760 00000100:00100000:3.0:1789607850.956508:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520149760 00000100:00100000:3.0:1789607850.956578:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 213 00000100:00100000:3.0:1789607850.956589:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+59:11639:x1876539520149760:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607850.956761:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607850.956788:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386ed4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98d5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.956863:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386ecd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.956877:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386ed4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98d5 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.956900:0:5847:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.956914:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386ed4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98d5 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.956930:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607850.956934:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607850.956937:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386ed4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98d5 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607850.956946:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c0030a00, rc 0) 00000100:00100000:3.0:1789607850.957020:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+60:11639:x1876539520149760:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 433us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607850.957027:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 213 00000001:00080000:1.0:1789607851.233953:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1789607851.233985:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1789607851.234000:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1789607851.234012:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00010000:00010000:1.0:1789607851.405739:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607851.660269:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789607851.660342:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607851.660373:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541109632:0@lo:400:kworker.0 00000100:00100000:2.0:1789607851.660502:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607851.660727:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541109632 00000100:00100000:0.0:1789607851.660811:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541109632 00000100:00100000:0.0:1789607851.660944:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789607851.660958:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541109632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607851.661040:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541109632:12345-0@lo:400:kworker.0 Request processed in 85us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607851.661049:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789607851.665903:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541109632:0@lo:400:kworker.0 00000100:00100000:3.0:1789607851.667400:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541109504:0@lo:400:kworker.0 00000100:00100000:3.0:1789607851.667527:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607851.669564:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876539541109760:0@lo:400:kworker.0 00000100:00100000:1.0:1789607851.669644:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607851.669691:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789607851.669697:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541109888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607851.669727:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607851.669783:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541109760 00000100:00100000:1.0:1789607851.669802:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541109760 00000100:00100000:1.0:1789607851.669893:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789607851.669905:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876539541109760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607851.670159:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876539541109760:12345-0@lo:400:kworker.0 Request processed in 256us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607851.670168:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789607851.670201:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541109888 00000100:00100000:1.0:1789607851.670205:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541109888 00000100:00100000:1.0:1789607851.670235:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789607851.670242:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541109888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607851.670274:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541109888:12345-0@lo:400:kworker.0 Request processed in 33us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607851.670280:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789607851.670321:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1789607851.670328:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:1.0:1789607851.670354:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a1ee292a00, transno 4294967307 00000004:00080000:1.0:1789607851.670369:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:1.0:1789607851.670386:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541109888:0@lo:400:kworker.0 00000100:00100000:1.0:1789607851.670399:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876539541109760:0@lo:400:kworker.0 00000100:00100000:3.0:1789607851.671468:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541110144:0@lo:400:kworker.0 00000100:00100000:3.0:1789607851.671537:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607851.671570:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607851.671577:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876539541110016:0@lo:400:kworker.0 00000100:00100000:3.0:1789607851.671607:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607851.671648:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541110016 00000100:00100000:3.0:1789607851.671654:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541110016 00000100:00100000:3.0:1789607851.671718:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789607851.671726:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876539541110016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607851.671802:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201654380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876539541110016:12345-0@lo:400:kworker.0 Request processed in 76us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607851.671810:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789607851.671851:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201878e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876539541110016:0@lo:400:kworker.0 00000100:00080000:2.0:1789607851.671952:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607851.673336:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541110144 00000100:00100000:1.0:1789607851.673351:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541110144 00000100:00100000:1.0:1789607851.673494:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789607851.673507:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a2016cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541110144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607851.673614:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a2016cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541110144:12345-0@lo:400:kworker.0 Request processed in 111us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607851.673622:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1789607851.673935:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607851.674022:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541110144:0@lo:400:kworker.0 00000100:00100000:0.0:1789607851.681439:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541109504 00000100:00100000:0.0:1789607851.681462:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541109504 00000100:00100000:0.0:1789607851.681562:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1789607851.681575:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3312:x1876539541109504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607851.681727:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3312:x1876539541109504:12345-0@lo:400:kworker.0 Request processed in 155us (14200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607851.681745:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789607851.683098:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541109504:0@lo:400:kworker.0 00000040:00080000:1.0:1789607851.854750:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607851.854789:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607851.854858:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789607851.854869:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789607851.855053:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201879880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1876539541110272:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789607851.855205:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607851.861784:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607851.862216:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520149888 00000100:00100000:2.0:1789607851.862232:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520149888 00000100:00100000:2.0:1789607851.862360:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 214 00000100:00100000:2.0:1789607851.862372:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:11640:x1876539520149888:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789607851.862419:0:6790:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789607851.862822:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:11640:x1876539520149888:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 449us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607851.862852:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 214 00000100:00080000:3.0:1789607851.864038:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607851.865048:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201879880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1876539541110272:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789607851.875167:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607851.875482:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520150016 00000100:00100000:3.0:1789607851.875497:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520150016 00000100:00100000:3.0:1789607851.875576:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 215 00000100:00100000:3.0:1789607851.875589:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+60:11640:x1876539520150016:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789607851.875883:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386edb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.875905:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386edb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.875921:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386edb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.875941:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386ee2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876073:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876082:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876115:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ee9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876124:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876130:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607851.876185:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789607851.876190:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607851.876207:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876220:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386edb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876227:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386edb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876235:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386edb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876242:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0030200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607851.876247:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386edb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876263:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386edb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876277:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1f911d000) 00010000:00010000:3.0:1789607851.876291:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607851.876300:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386edb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876307:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030200/0x33f091d001386edb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876321:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386ee2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876327:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386ee2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876332:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876337:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c0031600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607851.876339:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386ee2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876344:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386ee2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876358:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff99a1c3982500) 00010000:00010000:3.0:1789607851.876361:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607851.876364:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386ee2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876379:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031600/0x33f091d001386ee2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876398:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876404:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ee9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876410:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.876415:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607851.876420:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.878187:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ee9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.878209:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607851.878212:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607851.878219:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ee9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.878226:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386ee9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607851.879198:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+60:11640:x1876539520150016:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 Request processed in 3602us (4038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607851.879212:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 215 00000100:00100000:0.0:1789607851.885095:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607851.885201:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520150272 00000100:00100000:2.0:1789607851.885216:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520150272 00000100:00100000:2.0:1789607851.885626:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 216 00000100:00100000:2.0:1789607851.885651:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+60:11640:x1876539520150272:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607851.885688:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607851.885717:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386ef0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98dc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.885850:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386ef7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.885882:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.885896:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607851.885911:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789607851.886127:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386ef7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.886136:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386ef7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.886144:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.886151:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2c00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607851.886173:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386ef7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.886184:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386ef7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.886198:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:2.0:1789607851.886201:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789607851.886207:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386ef7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.886213:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2c00/0x33f091d001386ef7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.886267:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386ef0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98dc expref: 62 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.886278:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1f911d000) 00010000:00010000:2.0:1789607851.886291:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607851.886296:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2e00/0x33f091d001386ef0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98dc expref: 62 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.886307:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e2e00, rc 0) 00000100:00100000:2.0:1789607851.886408:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:11640:x1876539520150272:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 770us (1329us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1789607851.886416:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 216 00000100:00100000:0.0:1789607851.892027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607851.892233:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520150400 00000100:00100000:1.0:1789607851.892247:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520150400 00000100:00100000:1.0:1789607851.892355:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 217 00000100:00100000:1.0:1789607851.892368:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:11640:x1876539520150400:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789607851.892419:0:5849:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789607851.892593:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:11640:x1876539520150400:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 227us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607851.892818:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 217 00000100:00100000:3.0:1789607851.901582:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607851.901773:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520150656 00000100:00100000:0.0:1789607851.901786:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520150656 00000100:00100000:0.0:1789607851.901871:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 218 00000100:00100000:0.0:1789607851.901884:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:11640:x1876539520150656:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607851.901914:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607851.901919:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789607851.901966:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558ee00/0x33f091d001386e95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98c0 expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.902022:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:0.0:1789607851.902029:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607851.902048:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98e3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789607851.903059:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789607851.904710:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386f0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.904739:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.904754:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386f0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.904851:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98e3 expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.904879:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386f0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98e3 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.904889:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1f911d400) 00010000:00010000:0.0:1789607851.904891:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607851.904895:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ac800, rc 0) 00000100:00100000:0.0:1789607851.906163:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201655880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+62:11640:x1876539520150656:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 4268us (4583us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1789607851.906177:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 218 00000100:00100000:0.0:1789607851.911119:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607851.911298:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520150912 00000100:00100000:1.0:1789607851.911314:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520150912 00000100:00100000:1.0:1789607851.911401:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 219 00000100:00100000:1.0:1789607851.911415:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+62:11640:x1876539520150912:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607851.911965:0:5849:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607851.912005:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d001386f0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98e3 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.912031:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1f911d400) 00010000:00010000:1.0:1789607851.912045:0:5849:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607851.912076:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f1a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.912130:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.912144:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.912164:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386f21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xde470a06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.912172:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386f21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xde470a06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.912178:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386f21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xde470a06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.912272:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f1a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.912920:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f1a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.912930:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.912936:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eee00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607851.912942:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f1a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.912960:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f1a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.912974:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:1.0:1789607851.912986:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607851.912993:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.913000:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.913015:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386f21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xde470a06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.913022:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386f21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xde470a06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.913029:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386f21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xde470a06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.913034:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eec00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607851.913037:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386f21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xde470a06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.913043:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386f21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xde470a06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.913050:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xde470a06 (ffff99a1dab7d800) 00010000:00010000:1.0:1789607851.913053:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607851.913056:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386f21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xde470a06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.913062:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386f21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xde470a06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607851.913195:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:11640:x1876539520150912:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 1779us (2100us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789607851.913211:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 219 00000100:00100000:2.0:1789607851.920816:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607851.921263:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520151040 00000100:00100000:0.0:1789607851.921278:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520151040 00000100:00100000:0.0:1789607851.921387:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 220 00000100:00100000:0.0:1789607851.921401:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+61:11640:x1876539520151040:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607851.921593:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607851.921789:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98ea expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.921842:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386f2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.921860:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.921874:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386f2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.922024:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ea expref: 63 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.922052:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386f2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ea expref: 62 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.922063:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:0.0:1789607851.922067:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789607851.922072:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ad600, rc 0) 00000100:00100000:0.0:1789607851.922174:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+62:11640:x1876539520151040:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 775us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607851.922195:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 220 00000100:00100000:3.0:1789607851.925879:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607851.926402:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520151296 00000100:00100000:1.0:1789607851.926416:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520151296 00000100:00100000:1.0:1789607851.926791:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 221 00000100:00100000:1.0:1789607851.926805:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+62:11640:x1876539520151296:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607851.926927:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.926951:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.926967:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789607851.929149:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1789607851.929178:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385773754340ns, next at 386773748800ns, rc = 0 00000004:00010000:1.0:1789607851.929776:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072ddf1c4 reply state 000000008d901612 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607851.929791:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607851.929961:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201657100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+64:11640:x1876539520151296:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 3152us (4090us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789607851.929972:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 221 00000100:00100000:1.0:1789607851.932957:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1789607851.933787:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.933807:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.933817:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.933823:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eee00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607851.933829:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.933838:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.933860:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:3.0:1789607851.933864:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789607851.933871:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607851.933877:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386f36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607851.934173:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520151424 00000100:00100000:0.0:1789607851.934187:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520151424 00000100:00100000:0.0:1789607851.934270:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 222 00000100:00100000:0.0:1789607851.934283:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+63:11640:x1876539520151424:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607851.934318:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607851.934353:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98f1 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.934832:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98f1 expref: 64 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.934852:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98f1 expref: 64 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607851.934878:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:0.0:1789607851.934882:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607851.934885:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ad800, rc 0) 00000100:00100000:0.0:1789607851.934990:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201879880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+64:11640:x1876539520151424:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 709us (2045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607851.934998:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 222 00000100:00100000:2.0:1789607851.938014:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607851.938126:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520151552 00000100:00100000:1.0:1789607851.938140:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520151552 00000100:00100000:1.0:1789607851.938257:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:1.0:1789607851.938269:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2374:x1876539520151552:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789607851.938779:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:2374:x1876539520151552:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 510us (777us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789607851.938789:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:3.0:1789607851.941683:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607851.941853:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520151808 00000100:00100000:0.0:1789607851.941866:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520151808 00000100:00100000:0.0:1789607851.941931:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:0.0:1789607851.942220:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+64:11640:x1876539520151808:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789607851.942904:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+65:11640:x1876539520151808:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 960us (1230us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789607851.942932:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:0.0:1789607851.946182:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607851.947493:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520152064 00000100:00100000:2.0:1789607851.947508:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520152064 00000100:00100000:2.0:1789607851.947600:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 223 00000100:00100000:2.0:1789607851.947609:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+65:11640:x1876539520152064:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789607851.947767:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+65:11640:x1876539520152064:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 159us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607851.947774:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 223 00000100:00100000:2.0:1789607851.952814:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607851.954550:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520152192 00000100:00100000:1.0:1789607851.954573:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520152192 00000100:00100000:1.0:1789607851.954961:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 224 00000100:00100000:1.0:1789607851.954972:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+65:11640:x1876539520152192:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607851.954998:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607851.955028:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386f44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98f8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.955118:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.955137:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.955150:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607851.955201:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607851.955224:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.955252:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee800/0x33f091d001386f44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98f8 expref: 67 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.955269:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98f8 expref: 66 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.955297:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:1.0:1789607851.955299:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789607851.955303:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee000, rc 0) 00000100:00100000:1.0:1789607851.955385:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+66:11640:x1876539520152192:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 416us (2588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607851.955391:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 224 00000100:00100000:0.0:1789607851.958228:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607851.958334:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520152320 00000100:00100000:1.0:1789607851.958346:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520152320 00000100:00100000:1.0:1789607851.958958:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:1.0:1789607851.958973:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+10:2373:x1876539520152320:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607851.959165:0:8471:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607851.959199:0:8471:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5b93156/0x33f091d001386f52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b98ff expref: -99 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789607851.959241:0:8471:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab3fac, blocks: 0x1 00010000:00010000:1.0:1789607851.959275:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=385s v=(0 0) 00010000:00010000:1.0:1789607851.959280:0:8471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607851.959291:0:8471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5b93156/0x33f091d001386f52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ff expref: 11 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.959314:0:8471:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c5b93156/0x33f091d001386f52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ff expref: 11 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.959331:0:8471:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef800, rc 0) 00000100:00100000:1.0:1789607851.959497:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:2373:x1876539520152320:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 527us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607851.959504:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:0.0:1789607851.963970:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607851.964122:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520152576 00000100:00100000:1.0:1789607851.964135:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520152576 00000100:00100000:1.0:1789607851.964254:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 225 00000100:00100000:1.0:1789607851.964264:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+66:11640:x1876539520152576:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789607851.964398:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+66:11640:x1876539520152576:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 136us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607851.964404:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 225 00000100:00100000:2.0:1789607851.967702:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607851.967804:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520152704 00000100:00100000:1.0:1789607851.967817:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520152704 00000100:00100000:1.0:1789607851.967892:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 64 00000100:00100000:1.0:1789607851.967904:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:11640:x1876539520152704:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607851.967927:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607851.967962:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9906 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.968019:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5b93156/0x33f091d001386f52 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ff expref: 12 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.968030:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607851.968036:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607851.968042:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9906 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.968114:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c5b93156/0x33f091d001386f52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ff expref: 12 pid: 8471 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.968130:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c5b93156/0x33f091d001386f52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ff expref: 12 pid: 8471 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607851.968148:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876539541110400:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607851.968281:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607851.971019:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607851.971233:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876539541110400:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607851.971281:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9906 expref: 12 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607851.971308:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee800, rc 0) 00000100:00100000:1.0:1789607851.971399:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+12:11640:x1876539520152704:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 3496us (3712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607851.971411:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 64 00000100:00100000:2.0:1789607851.972080:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520152832 00000100:00100000:2.0:1789607851.972090:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520152832 00010000:00010000:2.0:1789607851.972136:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c5b93156/0x33f091d001386f52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ff expref: 12 pid: 8471 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607851.972174:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:2.0:1789607851.972184:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+12:2373:x1876539520152832:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607851.972203:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607851.972235:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c5b93156/0x33f091d001386f52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ff expref: 12 pid: 8471 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.972251:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c5b93156/0x33f091d001386f52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ff expref: 12 pid: 8471 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.972280:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5b93156/0x33f091d001386f52 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ff expref: 12 pid: 8471 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.972297:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607851.972301:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607851.972331:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9906 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.972342:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9906 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607851.972402:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9906 expref: 11 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607851.972420:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1facd7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5832:1876539541110528:192.168.202.3@tcp:105: 00000100:00100000:2.0:1789607851.972563:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607851.985747:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1facd7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5832:1876539541110528:192.168.202.3@tcp:105: 00010000:00010000:2.0:1789607851.985791:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607851.985929:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:2373:x1876539520152832:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 13744us (14921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607851.985951:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:0.0:1789607851.994195:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607851.995068:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520152960 00000100:00100000:1.0:1789607851.995084:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520152960 00002000:00100000:1.0:1789607851.995158:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff99a1c8d2c380 x1876539520152960/t0(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:407/0 lens 504/0 e 0 to 0 dl 1789607862 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789607851.995171:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1c8d2c380 with x1876539520152960 ext(0->12) 00002000:00010000:1.0:1789607851.995178:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1c8d2c380 00000100:00100000:1.0:1789607851.995224:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:1.0:1789607851.995255:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+11:2373:x1876539520152960:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789607851.996044:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:2373:x1876539520152960:12345-192.168.202.3@tcp:4:lhsmtool_posix.0 Request processed in 787us (1862us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1789607851.996054:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00002000:00100000:1.0:1789607851.996064:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff99a1c8d2c380 x1876539520152960/t4294967320(0) o4->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:407/0 lens 504/448 e 0 to 0 dl 1789607862 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789607851.996073:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1c8d2c380 with x1876539520152960 ext(0->12) 00002000:00010000:1.0:1789607851.996078:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1c8d2c380 00000100:00100000:3.0:1789607852.005591:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607852.008869:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520153088 00000100:00100000:2.0:1789607852.008891:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520153088 00000100:00100000:2.0:1789607852.008995:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 226 00000100:00100000:2.0:1789607852.009008:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+66:11640:x1876539520153088:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789607852.123417:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1789607852.123477:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789607852.123495:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a1ee72ab40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789607852.123500:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1c989aa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a1ee72aa80 00000020:00080000:3.0:1789607852.123523:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1c989a300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a201868400 00000004:00080000:3.0:1789607852.123552:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:3.0:1789607852.123569:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000020:00080000:3.0:1789607852.123638:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a1c8db36c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789607852.123642:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1ee548800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a1c1254a80 00000020:00080000:3.0:1789607852.123646:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1ee548300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a1e4d26000 00000100:00100000:2.0:1789607852.124067:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:11640:x1876539520153088:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 Request processed in 115052us (118483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607852.124081:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 226 00000100:00100000:0.0:1789607852.124452:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789607852.124473:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541110912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789607852.124541:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607852.124639:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541110912 00000100:00100000:0.0:1789607852.124649:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541110912 00000100:00100000:0.0:1789607852.124723:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789607852.124901:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541110912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789607852.124938:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1789607852.124985:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aab3faa, atime: 0x6aab3faa, ctime: 0x6aab3faa, blocks: 0xb 00010000:00010000:0.0:1789607852.124994:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000287495ff/0x33f091d001386f60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.125016:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1789607852.125021:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607852.125029:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000287495ff/0x33f091d001386f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.125049:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000287495ff/0x33f091d001386f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.125080:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000287495ff/0x33f091d001386f60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.125088:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000287495ff/0x33f091d001386f60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.125123:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789607852.127419:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541110912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2673us (2863us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789607852.127480:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1789607852.127539:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789607852.127560:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607852.127573:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000287495ff/0x33f091d001386f60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.127591:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac600 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607852.127614:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000287495ff/0x33f091d001386f60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.127630:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000287495ff/0x33f091d001386f60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.127671:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000287495ff/0x33f091d001386f60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.127707:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000287495ff/0x33f091d001386f60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.128253:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607852.128256:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607852.128259:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607852.130248:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1facd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541110656:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789607852.130366:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607852.130460:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607852.130469:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1facd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541110784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789607852.130495:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789607852.130529:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789607852.131069:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789607852.131093:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541110656 00000100:00100000:0.0:1789607852.131155:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541110656 00000100:00100000:0.0:1789607852.131213:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541110784 00000100:00100000:0.0:1789607852.131217:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541110784 00000100:00100000:0.0:1789607852.131235:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789607852.131245:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1876539541110656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789607852.131285:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1789607852.131319:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607852.131465:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789607852.131477:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1876539541110784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789607852.131664:0:8471:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789607852.131668:0:8471:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789607852 00002000:00010000:1.0:1789607852.131670:0:8471:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789607852.131673:0:8471:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789607852 -> 1789607852 00002000:00010000:1.0:1789607852.131676:0:8471:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789607852.131749:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1876539541110784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 275us (1252us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789607852.131757:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1789607852.131991:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386d22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9865 expref: 12 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.132029:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1789607852.132034:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789607852.132040:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.132087:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386d22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9865 expref: 12 pid: 8471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.132102:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386d22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9865 expref: 12 pid: 8471 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607852.132182:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876539541111040:192.168.202.3@tcp:104: 00000100:00100000:0.0:1789607852.132276:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c5455d80 going to sleep for 11 seconds 00000004:00080000:0.0:1789607852.132324:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a1facd6d80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1789607852.132331:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1facd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541110784:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1789607852.136056:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a1c8d2f480/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789607852.136079:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541110912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789607852.137266:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607852.137405:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607852.137500:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520153344 00000100:00100000:3.0:1789607852.137511:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520153344 00010000:00010000:3.0:1789607852.137580:0:8517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386d22 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9865 expref: 13 pid: 8471 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607852.137641:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:3.0:1789607852.137664:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:2374:x1876539520153344:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607852.137682:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607852.137689:0:8517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386d22 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9865 expref: 13 pid: 8471 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.137705:0:8517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386d22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9865 expref: 13 pid: 8471 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.137748:0:8517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607852.137753:0:8517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607852.137760:0:8517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.137792:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.137919:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607852.137995:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+13:2374:x1876539520153344:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 343us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607852.138004:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 82 00010000:00010000:2.0:1789607852.138332:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386d22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9865 expref: 12 pid: 8471 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607852.138367:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876539541111040:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607852.138395:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.138408:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.138416:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.138459:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.138469:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.138500:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789607852.139517:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3309:x1876539541110656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8269us (9148us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789607852.139529:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789607852.139557:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520153216 00000100:00100000:2.0:1789607852.139564:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520153216 00010000:00010000:3.0:1789607852.139647:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607852.139668:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.139681:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ada00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:3.0:1789607852.139687:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.139698:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.139719:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789607852.139931:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789607852.140381:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cd97150/0x33f091d001386f67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.140412:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607852.140454:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607852.140457:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607852.141174:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:1.0:1789607852.141194:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+12:2374:x1876539520153216:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1789607852.141531:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a1facd7b80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789607852.141541:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1facd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541110656:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789607852.171620:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607852.171667:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541111168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607852.171977:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607852.172044:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541111168 00000100:00100000:0.0:1789607852.172054:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541111168 00000100:00100000:0.0:1789607852.172126:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789607852.172138:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3311:x1876539541111168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607852.172192:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607852.172246:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3311:x1876539541111168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607852.172255:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789607852.172317:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541111168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607852.196523:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+12:2374:x1876539520153216:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 Request processed in 55317us (59246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607852.196541:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 68 00000001:00080000:3.0:1789607852.196831:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1789607852.196849:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1789607852.196882:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:0.0:1789607852.202276:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607852.202498:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520153600 00000100:00100000:1.0:1789607852.202511:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520153600 00000100:00100000:1.0:1789607852.202602:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 227 00000100:00100000:1.0:1789607852.202616:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:11640:x1876539520153600:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607852.202902:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607852.202944:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98f8 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.202972:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:1.0:1789607852.202979:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607852.203024:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386f6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.203043:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386f6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.203055:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386f6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607852.203593:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008bd231d9 reply state 00000000971532b6 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386f6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607852.203605:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607852.204061:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:11640:x1876539520153600:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 1444us (1798us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789607852.204071:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 227 00000100:00100000:2.0:1789607852.208866:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:3.0:1789607852.209003:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386f6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.209020:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386f6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.209031:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386f6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.209039:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607852.209045:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386f6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.209054:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386f6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.209074:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:3.0:1789607852.209078:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607852.209085:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386f6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.209092:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee600/0x33f091d001386f6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607852.209180:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520153728 00000100:00100000:1.0:1789607852.209193:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520153728 00000100:00100000:1.0:1789607852.209263:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:1.0:1789607852.209275:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2375:x1876539520153728:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789607852.209678:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789607852.209683:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789607852 -> 1789607850 00002000:00010000:1.0:1789607852.209686:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789607850 00002000:00010000:1.0:1789607852.209703:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789607852 -> 1789607850 00002000:00010000:1.0:1789607852.209706:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789607852.211942:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2375:x1876539520153728:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 2652us (3075us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789607852.211961:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:3.0:1789607852.215999:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607852.216249:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520153984 00000100:00100000:1.0:1789607852.216264:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520153984 00000100:00100000:1.0:1789607852.216359:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 228 00000100:00100000:1.0:1789607852.216373:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:11640:x1876539520153984:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789607852.216504:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.216526:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386f2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ea expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.216537:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.216587:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386f2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ea expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.216603:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386f2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ea expref: 20 pid: 5848 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607852.216620:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541111296:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607852.216928:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607852.222617:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607852.222925:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541111296:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607852.222999:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607852.223100:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520154112 00000100:00100000:0.0:1789607852.223118:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520154112 00010000:00010000:0.0:1789607852.223167:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386f2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ea expref: 21 pid: 5848 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607852.223217:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 83 00000100:00100000:0.0:1789607852.223228:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:2373:x1876539520154112:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607852.223246:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607852.223254:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386f2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ea expref: 21 pid: 5848 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.223268:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386f2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ea expref: 21 pid: 5848 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.223296:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001386f2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ea expref: 21 pid: 5848 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.223318:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:0.0:1789607852.223324:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.223359:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.223369:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.223402:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607852.223523:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:2373:x1876539520154112:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 295us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607852.223532:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 83 00010000:00010000:1.0:1789607852.223925:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.223934:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.223971:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.223979:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.223987:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.223994:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607852.224000:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.224008:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.224020:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:1.0:1789607852.224024:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789607852.224028:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.224035:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607852.224119:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:11640:x1876539520153984:12345-192.168.202.3@tcp:55:lhsmtool_posix.0 Request processed in 7749us (8136us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789607852.224129:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 228 00000100:00100000:3.0:1789607852.230905:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607852.231013:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520154240 00000100:00100000:2.0:1789607852.231029:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520154240 00000100:00100000:2.0:1789607852.231119:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 70 00000100:00100000:2.0:1789607852.231130:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2374:x1876539520154240:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789607852.231193:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.231219:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9906 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.231229:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789607852.231235:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789607852.231241:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.231288:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9906 expref: 8 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.231305:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9906 expref: 8 pid: 6695 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607852.231323:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1facd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876539541111424:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607852.231488:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15240 going to sleep for 11 seconds 00000100:00100000:3.0:1789607852.236293:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1facd5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6695:1876539541111424:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607852.236356:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607852.238246:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607852.238810:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520154368 00000100:00100000:3.0:1789607852.238822:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520154368 00010000:00010000:3.0:1789607852.238876:0:8517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9906 expref: 9 pid: 6695 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607852.238930:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:3.0:1789607852.238942:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+9:2373:x1876539520154368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607852.238961:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607852.238999:0:8517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9906 expref: 9 pid: 6695 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.239013:0:8517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9906 expref: 9 pid: 6695 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.239045:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c2b1769/0x33f091d001386f59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9906 expref: 9 pid: 6695 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.239067:0:8517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607852.239072:0:8517:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607852.239080:0:8517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.239221:0:8517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.239322:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607852.239595:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2373:x1876539520154368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 653us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607852.239604:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 84 00010000:00010000:1.0:1789607852.242302:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.242328:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.242708:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.242719:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.242791:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.242801:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3000 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607852.242806:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.242816:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.242872:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.242881:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf7c1542/0x33f091d001386f7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607852.243195:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2374:x1876539520154240:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 Request processed in 12059us (12299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607852.243207:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 70 00000100:00100000:0.0:1789607852.247506:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607852.247619:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520154624 00000100:00100000:2.0:1789607852.247633:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520154624 00000100:00100000:2.0:1789607852.247742:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 229 00000100:00100000:2.0:1789607852.247774:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:11640:x1876539520154624:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789607852.247877:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386f83 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.247899:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386f83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.247914:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386f83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.248206:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.248228:0:11489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98f1 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.248237:0:11489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.248282:0:11489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98f1 expref: 20 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.248297:0:11489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98f1 expref: 20 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607852.248313:0:11489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1facd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541111552:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607852.248466:0:11489:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15240 going to sleep for 11 seconds 00000100:00100000:2.0:1789607852.255186:0:11489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1facd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541111552:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607852.255247:0:11489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607852.258000:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607852.258914:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520154752 00000100:00100000:3.0:1789607852.258932:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520154752 00010000:00010000:3.0:1789607852.258989:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98f1 expref: 21 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607852.259043:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:3.0:1789607852.259056:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:2373:x1876539520154752:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607852.259077:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607852.259085:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98f1 expref: 21 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.259103:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98f1 expref: 21 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.259603:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d001386f3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98f1 expref: 21 pid: 5849 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.259627:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:3.0:1789607852.259725:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.259802:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.259812:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.259852:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607852.260051:0:11489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.260061:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607852.260359:0:11489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1789607852.260563:0:11489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1789607852.260630:0:11489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1789607852.261301:0:11489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1facd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11489:1876539541111680:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789607852.261452:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:2373:x1876539520154752:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 2394us (3464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607852.261465:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:2.0:1789607852.261977:0:11489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607852.262026:0:11489:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607852.264078:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541111680 00000100:00100000:3.0:1789607852.264101:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541111680 00000100:00100000:3.0:1789607852.264212:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607852.264224:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11489:x1876539541111680:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1789607852.264403:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11489:x1876539541111680:12345-0@lo:1000:mdt00_004.0 Request processed in 182us (2427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607852.264411:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607852.264818:0:11489:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1789607852.264826:0:11489:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:2.0:1789607852.264857:0:11489:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a1facd6d80, transno 4294967321 00000004:00080000:2.0:1789607852.264876:0:11489:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a1facd7b80, transno 4294967322 00000100:00100000:2.0:1789607852.264885:0:11489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1facd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11489:1876539541111680:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1789607852.265562:0:11489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1789607852.265703:0:11489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1facd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11489:1876539541111808:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789607852.265769:0:11489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607852.265811:0:11489:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c5455a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607852.265841:0:12495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541111808 00000100:00100000:2.0:1789607852.265849:0:12495:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541111808 00000100:00100000:2.0:1789607852.265890:0:12495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789607852.265898:0:12495:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:11489:x1876539541111808:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1789607852.266110:0:12495:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:11489:x1876539541111808:12345-0@lo:1000:mdt00_004.0 Request processed in 212us (340us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789607852.266130:0:12495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789607852.266180:0:11489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1facd4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11489:1876539541111808:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1789607852.266221:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266232:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266241:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266246:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607852.266252:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266260:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266279:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1f911d300) 00010000:00010000:2.0:1789607852.266282:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607852.266288:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266295:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f8a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266333:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386ecd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266340:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386ecd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266359:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386ecd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266364:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efe00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607852.266367:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386ecd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266372:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386ecd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266383:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:2.0:1789607852.266385:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607852.266392:0:11489:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386ed4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98d5 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266405:0:11489:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386ed4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98d5 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266416:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98d5 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.266476:0:11489:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386ed4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98d5 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607852.266488:0:11489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1facd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541111936:192.168.202.3@tcp:105: 00000100:00100000:2.0:1789607852.266566:0:11489:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c97a4840 going to sleep for 11 seconds 00000100:00100000:0.0:1789607852.274539:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607852.274788:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520154880 00000100:00100000:2.0:1789607852.274801:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520154880 00000100:00100000:2.0:1789607852.274919:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:2.0:1789607852.274932:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11639:x1876539520154880:12345-192.168.202.3@tcp:49:lfs.0 00000100:00100000:1.0:1789607852.275018:0:11489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1facd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11489:1876539541111936:192.168.202.3@tcp:105: 00010000:00010000:1.0:1789607852.275057:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386ecd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275071:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386ecd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607852.275119:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11639:x1876539520154880:12345-192.168.202.3@tcp:49:lfs.0 Request processed in 189us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607852.275129:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 61 00010000:00010000:1.0:1789607852.275324:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f91 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275343:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275358:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275371:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f91 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275390:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f91 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275398:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275404:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607852.275408:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f91 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275416:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f91 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275618:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:1.0:1789607852.275622:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607852.275627:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f91 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275634:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f91 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275664:0:11489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386f83 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275671:0:11489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386f83 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275678:0:11489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386f83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275683:0:11489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607852.275693:0:11489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386f83 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275701:0:11489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386f83 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275710:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:1.0:1789607852.275713:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789607852.275716:0:11489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386f83 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.275722:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386f83 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607852.276301:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:11640:x1876539520154624:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 28526us (28809us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1789607852.276313:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 229 00000020:00080000:1.0:1789607852.276319:0:11489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789607852.276535:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789607852.276541:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789607852.277131:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789607852.277145:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789607852.280294:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607852.280861:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520155136 00000100:00100000:3.0:1789607852.280876:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520155136 00000100:00100000:0.0:1789607852.281587:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607852.281673:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520155392 00000100:00100000:1.0:1789607852.281679:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520155392 00000100:00100000:1.0:1789607852.281754:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 230 00000100:00100000:1.0:1789607852.281766:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c5272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11639:x1876539520155392:12345-192.168.202.3@tcp:58:lfs.0 00000040:00080000:1.0:1789607852.282287:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789607852.282410:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c5272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+24:11639:x1876539520155392:12345-192.168.202.3@tcp:58:lfs.0 Request processed in 645us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607852.282419:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 230 00000100:00100000:2.0:1789607852.284548:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:2.0:1789607852.284566:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1db76c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+23:11640:x1876539520155136:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789607852.286807:0:12083:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789607852.287209:0:12083:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1789607852.287290:0:12083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.287312:0:12083:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.287326:0:12083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.287403:0:12083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f98 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.287411:0:12083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f98 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.287417:0:12083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607852.287558:0:12083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607852.287800:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607852.287808:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.287817:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2600 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607852.287822:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.287831:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.287846:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a1db790500) 00010000:00010000:0.0:1789607852.287850:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789607852.287863:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f98 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.287869:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386f98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 12083 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607852.287891:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607852.287893:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607852.287895:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607852.288136:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1db76c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+25:11640:x1876539520155136:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 3568us (7854us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789607852.288148:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 62 00000020:00080000:2.0:1789607852.288156:0:12083:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789607852.319786:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607852.320044:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520155520 00000100:00100000:1.0:1789607852.320057:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520155520 00000100:00100000:1.0:1789607852.320140:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 231 00000100:00100000:1.0:1789607852.320152:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+25:11642:x1876539520155520:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607852.320210:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607852.320238:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b990d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.320322:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386fa6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.320351:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.320366:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.320385:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386fad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.320392:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.320400:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.320779:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386fb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.320791:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ce expref: 26 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.320800:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386fb4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.320844:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ce expref: 26 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.320869:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ce expref: 26 pid: 6790 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607852.320887:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541112064:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607852.320989:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e2300 going to sleep for 11 seconds 00000100:00100000:0.0:1789607852.324503:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607852.324861:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5849:1876539541112064:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607852.324911:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386fb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607852.325008:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520155776 00000100:00100000:2.0:1789607852.325017:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520155776 00000100:00100000:2.0:1789607852.325089:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:2.0:1789607852.325101:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:5614:x1876539520155776:12345-192.168.202.3@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789607852.325893:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:5614:x1876539520155776:12345-192.168.202.3@tcp:35:ldlm_bl.0 Request processed in 790us (1400us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789607852.325904:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 63 00000100:00100000:2.0:1789607852.331574:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607852.331877:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520155904 00000100:00100000:3.0:1789607852.331889:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520155904 00010000:00010000:3.0:1789607852.332010:0:8517:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ce expref: 28 pid: 6790 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607852.332098:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:3.0:1789607852.332109:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:2373:x1876539520155904:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607852.332162:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607852.332171:0:8517:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ce expref: 28 pid: 6790 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.332187:0:8517:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ce expref: 28 pid: 6790 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.332215:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3400/0x33f091d001386ebf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98ce expref: 28 pid: 6790 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.332236:0:8517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607852.332242:0:8517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386fb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.332254:0:8517:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.332264:0:8517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386fb4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607852.332301:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607852.332487:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+27:2373:x1876539520155904:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 379us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607852.332497:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 86 00010000:00010000:1.0:1789607852.332616:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.332627:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607852.332697:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789607852.332704:0:5849:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607852.333453:0:5849:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333480:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333495:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386fa6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333503:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386fa6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333529:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333541:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efe00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607852.333546:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386fa6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333555:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386fa6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333569:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:1.0:1789607852.333572:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607852.333577:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386fa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333585:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efe00/0x33f091d001386fa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333611:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386fad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333618:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386fad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333624:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333629:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607852.333632:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386fad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333667:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386fad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333676:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a1dab7d800) 00010000:00010000:1.0:1789607852.333679:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607852.333682:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386fad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333688:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef800/0x33f091d001386fad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333750:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d001386f9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b990d expref: 27 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333767:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b990d expref: 26 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607852.333774:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:1.0:1789607852.333777:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607852.333779:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4eee00, rc 0) 00000100:00100000:1.0:1789607852.333856:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffad7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:11642:x1876539520155520:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 13706us (14085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607852.333865:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 231 00010000:00010000:3.0:1789607852.428528:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789607853.229215:0:12578:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607853.229229:0:12578:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607853.229285:0:12578:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789607853.229294:0:12578:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789607853.324008:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789607853.324029:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789607853.324083:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789607853.324092:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789607853.324265:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1876539541112192:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789607853.325516:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c23e20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607853.332077:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1876539541112192:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789607853.332757:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607853.332898:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520156032 00000100:00100000:0.0:1789607853.332909:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520156032 00000100:00100000:0.0:1789607853.333003:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 232 00000100:00100000:0.0:1789607853.333016:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:11654:x1876539520156032:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789607853.333063:0:11489:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789607853.333191:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:11654:x1876539520156032:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 178us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607853.333199:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 232 00000100:00080000:3.0:1789607853.333686:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607853.337843:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607853.337985:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520156288 00000100:00100000:3.0:1789607853.337998:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520156288 00000100:00100000:3.0:1789607853.338079:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 233 00000100:00100000:3.0:1789607853.338113:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+26:11654:x1876539520156288:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607853.338144:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607853.338174:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386fbb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9914 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607853.338312:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386fc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607853.338331:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607853.338347:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607853.338362:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789607853.338564:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f800/0x33f091d001386fbb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9914 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607853.338589:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9914 expref: 28 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607853.338598:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:3.0:1789607853.338602:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607853.338607:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f000, rc 0) 00000100:00100000:3.0:1789607853.338702:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:11654:x1876539520156288:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 592us (873us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789607853.338711:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 233 00000100:00100000:2.0:1789607853.346279:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607853.346376:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520156544 00000100:00100000:1.0:1789607853.346391:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520156544 00000100:00100000:1.0:1789607853.346511:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 234 00000100:00100000:1.0:1789607853.346525:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:11654:x1876539520156544:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789607853.347094:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386fd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607853.347120:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607853.347134:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607853.347385:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386fd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607853.347392:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386fd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607853.347400:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607853.347406:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eec00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607853.347411:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386fd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607853.347482:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386fd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607853.347498:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:1.0:1789607853.347502:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789607853.347509:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386fd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607853.347515:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d001386fd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607853.349627:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:11654:x1876539520156544:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 3088us (3348us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789607853.349656:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 234 00000040:00080000:2.0:1789607853.350336:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789607853.350344:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789607853.351979:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789607853.352006:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789607853.354108:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607853.354464:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520156672 00000100:00100000:2.0:1789607853.354478:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520156672 00000100:00100000:2.0:1789607853.354574:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:2.0:1789607853.354596:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:2373:x1876539520156672:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607853.354617:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607853.354660:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f000/0x33f091d001386fc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9914 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607853.354714:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:2.0:1789607853.354722:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607853.355076:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:2373:x1876539520156672:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 491us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607853.355086:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:3.0:1789607853.356074:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607853.356490:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520156928 00000100:00100000:2.0:1789607853.356502:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520156928 00000100:00100000:2.0:1789607853.356562:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 64 00000100:00100000:2.0:1789607853.356573:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+28:11654:x1876539520156928:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789607853.357669:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:11654:x1876539520156928:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 1091us (1593us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789607853.357681:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 64 00010000:00010000:2.0:1789607853.452725:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607853.718490:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607853.718526:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541112320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607853.718650:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607853.718888:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541112320 00000100:00100000:0.0:1789607853.718899:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541112320 00000100:00100000:0.0:1789607853.718970:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789607853.718981:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876539541112320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607853.719036:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607853.719114:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1876539541112320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607853.719146:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789607853.719535:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541112320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789607854.476335:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789607855.038272:0:12630:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607855.038287:0:12630:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607855.038348:0:12630:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789607855.038355:0:12630:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789607855.236084:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607855.237548:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520157184 00000100:00100000:2.0:1789607855.237582:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520157184 00000100:00100000:2.0:1789607855.237710:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 235 00000100:00100000:2.0:1789607855.237725:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+29:11674:x1876539520157184:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607855.237760:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607855.237792:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386fd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b991b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.237961:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386fde lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.237981:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386fde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.238000:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386fde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607855.238016:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789607855.238203:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3c00/0x33f091d001386fd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b991b expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.238224:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386fde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b991b expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.238233:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:2.0:1789607855.238237:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789607855.238242:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e2400, rc 0) 00000100:00100000:2.0:1789607855.238330:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:11674:x1876539520157184:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 609us (2260us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789607855.238339:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 235 00000100:00080000:1.0:1789607855.239924:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607855.246355:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607855.246931:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520157312 00000100:00100000:2.0:1789607855.246946:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520157312 00000100:00100000:2.0:1789607855.247067:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 236 00000100:00100000:2.0:1789607855.247080:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:11674:x1876539520157312:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:2.0:1789607855.247183:0:6790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386fec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.247220:0:6790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.247234:0:6790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.247271:0:6790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.247278:0:6790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386fec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.247286:0:6790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.247294:0:6790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607855.247299:0:6790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.247318:0:6790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386fec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.247333:0:6790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:2.0:1789607855.247337:0:6790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607855.247344:0:6790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386fec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607855.247351:0:6790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2600/0x33f091d001386fec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607855.247467:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+31:11674:x1876539520157312:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 388us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607855.247481:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 236 00000100:00100000:3.0:1789607855.327067:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607855.327351:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520157440 00000100:00100000:0.0:1789607855.327365:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520157440 00000100:00100000:0.0:1789607855.327519:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 71 00000100:00100000:0.0:1789607855.327532:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2375:x1876539520157440:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1789607855.327557:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607855.327597:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006087e0f3/0x33f091d001386ff3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9922 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607855.327645:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aab3faa, atime: 0x6aab3faa, ctime: 0x6aab3faa, blocks: 0xb 00010000:00010000:0.0:1789607855.327676:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=389s v=(0 0) 00010000:00010000:0.0:1789607855.327683:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607855.327697:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006087e0f3/0x33f091d001386ff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9922 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607855.327720:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006087e0f3/0x33f091d001386ff3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9922 expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607855.327739:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ad000, rc 0) 00000100:00080000:1.0:1789607855.327931:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607855.327995:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2375:x1876539520157440:12345-192.168.202.3@tcp:101:cat.0 Request processed in 462us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607855.328005:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 71 00000100:00100000:2.0:1789607855.331690:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607855.332370:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520157568 00000100:00100000:3.0:1789607855.332388:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520157568 00002000:00100000:3.0:1789607855.332513:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff99a1facd7100 x1876539520157568/t0(0) o3->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:411/0 lens 488/0 e 0 to 0 dl 1789607866 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789607855.332527:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1facd7100 with x1876539520157568 ext(0->4095) 00002000:00010000:3.0:1789607855.332533:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1facd7100 00000100:00100000:3.0:1789607855.332574:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1789607855.332587:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2376:x1876539520157568:12345-192.168.202.3@tcp:3:cat.0 00000100:00100000:3.0:1789607855.333172:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+8:2376:x1876539520157568:12345-192.168.202.3@tcp:3:cat.0 Request processed in 584us (1504us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789607855.333182:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00002000:00100000:3.0:1789607855.333190:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff99a1facd7100 x1876539520157568/t0(0) o3->d0d9aceb-01dc-4deb-add2-cd492a0443a6@192.168.202.3@tcp:411/0 lens 488/4536 e 0 to 0 dl 1789607866 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789607855.333199:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1facd7100 with x1876539520157568 ext(0->4095) 00002000:00010000:3.0:1789607855.333204:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1facd7100 00010000:00010000:2.0:1789607855.501013:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607855.920786:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607855.921039:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607855.921147:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607855.921188:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520157824 00000100:00100000:3.0:1789607855.921200:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520157824 00000100:00100000:3.0:1789607855.921280:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 95 00000100:00100000:3.0:1789607855.921291:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2374:x1876539520157824:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607855.921387:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2374:x1876539520157824:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607855.921396:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 95 00000100:00080000:3.0:1789607855.921468:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607855.922174:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520157696 00000100:00100000:0.0:1789607855.922184:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520157696 00000100:00100000:0.0:1789607855.922250:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 300 00000100:00100000:0.0:1789607855.922261:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2374:x1876539520157696:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607855.922499:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2374:x1876539520157696:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 239us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607855.922518:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 300 00000100:00100000:2.0:1789607855.929669:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520157952 00000100:00100000:2.0:1789607855.929690:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520157952 00000100:00100000:2.0:1789607855.929797:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 164 00000100:00100000:2.0:1789607855.929807:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520157952:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607855.929915:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2374:x1876539520157952:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 108us (8875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607855.929923:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 164 00000100:00080000:1.0:1789607855.929939:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789607856.372595:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1789607856.523753:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607856.779704:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541112576:0@lo:400:kworker.0 00000100:00100000:2.0:1789607856.779862:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541112448:0@lo:400:kworker.0 00000100:00100000:3.0:1789607856.780012:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541112832:0@lo:400:kworker.0 00000100:00100000:2.0:1789607856.780026:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607856.780090:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541112448 00000100:00100000:2.0:1789607856.780096:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541112960:0@lo:400:kworker.0 00000100:00100000:1.0:1789607856.780102:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541112448 00000100:00100000:2.0:1789607856.780121:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607856.780161:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1789607856.780165:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541112960 00000100:00100000:2.0:1789607856.780168:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541112960 00000100:00100000:1.0:1789607856.780171:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541112448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607856.780211:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789607856.780218:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541112960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607856.780248:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541112448:12345-0@lo:400:kworker.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607856.780251:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541112960:12345-0@lo:400:kworker.0 Request processed in 35us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607856.780257:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789607856.780257:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:1.0:1789607856.780292:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607856.780322:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607856.780325:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541112448:0@lo:400:kworker.0 00000100:00100000:1.0:1789607856.780339:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541112960:0@lo:400:kworker.0 00000100:00100000:0.0:1789607856.780387:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541113088:0@lo:400:kworker.0 00000100:00100000:0.0:1789607856.780414:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607856.780458:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607856.780465:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541112704:0@lo:400:kworker.0 00000100:00100000:0.0:1789607856.780500:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607856.780522:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541113088 00000100:00100000:1.0:1789607856.780527:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541113088 00000100:00100000:1.0:1789607856.780564:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789607856.780571:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541113088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607856.780604:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541113088:12345-0@lo:400:kworker.0 Request processed in 33us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607856.780619:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1789607856.780637:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607856.780638:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541113088:0@lo:400:kworker.0 00000100:00100000:2.0:1789607856.780929:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541112576 00000100:00100000:2.0:1789607856.780942:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541112576 00000100:00100000:2.0:1789607856.780974:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541112704 00000100:00100000:2.0:1789607856.780978:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541112704 00000100:00100000:1.0:1789607856.780997:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789607856.781005:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541112576:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789607856.781038:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607856.781065:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff9e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541112576:12345-0@lo:400:kworker.0 Request processed in 61us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607856.781131:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541112576:0@lo:400:kworker.0 00000100:00100000:2.0:1789607856.781946:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789607856.781957:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541112704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607856.782156:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789607856.782663:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541112704:12345-0@lo:400:kworker.0 Request processed in 707us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607856.782671:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789607856.784634:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541112704:0@lo:400:kworker.0 00000100:00100000:3.0:1789607856.785320:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607856.785534:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541112832 00000100:00100000:1.0:1789607856.785545:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541112832 00000100:00100000:1.0:1789607856.785631:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789607856.785642:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541112832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607856.785739:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541112832:12345-0@lo:400:kworker.0 Request processed in 99us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607856.785749:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789607856.785792:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1789607856.785799:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a1c8d2f480, transno 4294967310 00000100:00100000:1.0:1789607856.785822:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee932680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541112832:0@lo:400:kworker.0 00000100:00080000:3.0:1789607856.786157:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607857.300634:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c527dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541113216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607857.300735:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607857.301936:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541113216 00000100:00100000:3.0:1789607857.301953:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541113216 00000100:00100000:3.0:1789607857.302023:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789607857.302036:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541113216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607857.302085:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607857.302162:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1876539541113216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607857.302170:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789607857.302233:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c527dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541113216:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1789607857.386786:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1789607857.386830:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000020:00080000:3.0:1789607857.424809:0:5869:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1789607857.424845:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:3.0:1789607857.424885:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1789607857.424906:0:5869:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a1e8a15240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789607857.424912:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1ee548c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a1e8b67780 00000020:00080000:3.0:1789607857.424916:0:5869:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a1ee548e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a1fafc8c00 00000020:00080000:0.0:1789607857.425166:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789607857.425491:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1789607857.555899:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789607858.508045:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789607858.508057:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789607858.508099:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789607858.508108:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789607858.571740:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607858.829239:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789607858.829275:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541113344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607858.829381:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607858.829748:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541113344 00000100:00100000:1.0:1789607858.829761:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541113344 00000100:00080000:3.0:1789607858.829976:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607858.829977:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789607858.829994:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541113344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789607858.830045:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607858.830121:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541113344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607858.830128:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789607858.830232:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541113344:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789607859.596340:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607860.302148:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607860.305565:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520158080 00000100:00100000:1.0:1789607860.305592:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520158080 00000100:00100000:1.0:1789607860.305754:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 237 00000100:00100000:1.0:1789607860.305768:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:11327:x1876539520158080:12345-192.168.202.3@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789607860.305892:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:11327:x1876539520158080:12345-192.168.202.3@tcp:60:lhsmtool_posix.0 Request processed in 128us (3753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607860.305910:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 237 00000100:00080000:3.0:1789607860.311079:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607860.314675:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607860.315045:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520158336 00000100:00100000:1.0:1789607860.315055:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520158336 00000100:00100000:1.0:1789607860.315646:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 65 00000100:00100000:1.0:1789607860.315655:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:11327:x1876539520158336:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789607860.315965:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:11327:x1876539520158336:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 309us (1299us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789607860.315973:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 65 00010000:00010000:1.0:1789607860.620486:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607861.040389:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607861.040524:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607861.040542:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607861.040596:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607861.040688:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520158720 00000100:00100000:2.0:1789607861.040698:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520158720 00000100:00100000:2.0:1789607861.040760:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520158592 00000100:00100000:2.0:1789607861.040764:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520158592 00000100:00100000:2.0:1789607861.040787:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:2.0:1789607861.040796:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2375:x1876539520158720:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607861.040872:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2375:x1876539520158720:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 77us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607861.040880:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:2.0:1789607861.040897:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00100000:2.0:1789607861.040904:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520158592:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607861.040928:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2375:x1876539520158592:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607861.040948:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00080000:0.0:1789607861.041534:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607861.041540:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607861.041704:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520158848 00000100:00100000:1.0:1789607861.041722:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520158848 00000100:00100000:1.0:1789607861.041790:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 168 00000100:00100000:1.0:1789607861.041799:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2375:x1876539520158848:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607861.041847:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2375:x1876539520158848:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 50us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607861.041854:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 168 00000100:00080000:0.0:1789607861.042012:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607861.042797:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520158464 00000100:00100000:3.0:1789607861.042805:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520158464 00000100:00100000:3.0:1789607861.042850:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 302 00000100:00100000:3.0:1789607861.042858:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2375:x1876539520158464:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607861.043018:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2375:x1876539520158464:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 160us (2638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607861.043027:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 302 00010000:00010000:3.0:1789607861.643579:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607861.904199:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541113472:0@lo:400:kworker.0 00000100:00100000:0.0:1789607861.904281:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607861.904370:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541113984:0@lo:400:kworker.0 00000100:00100000:0.0:1789607861.904400:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607861.904450:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607861.904457:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541113856:0@lo:400:kworker.0 00000100:00100000:0.0:1789607861.904486:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607861.904606:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541113984 00000100:00100000:0.0:1789607861.904613:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541113984 00000100:00100000:0.0:1789607861.904671:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789607861.904681:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541113984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607861.904733:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541113984:12345-0@lo:400:kworker.0 Request processed in 53us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607861.904740:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789607861.904766:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541113856 00000100:00100000:0.0:1789607861.904769:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541113856 00000100:00100000:0.0:1789607861.904797:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789607861.904804:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541113856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607861.904832:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541113856:12345-0@lo:400:kworker.0 Request processed in 29us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607861.904838:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1789607861.904854:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607861.904858:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607861.904890:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541113856:0@lo:400:kworker.0 00000100:00100000:0.0:1789607861.904901:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541113984:0@lo:400:kworker.0 00000100:00100000:1.0:1789607861.907625:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541113472 00000100:00100000:1.0:1789607861.907636:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541113472 00000100:00100000:1.0:1789607861.907684:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789607861.907694:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541113472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607861.907776:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3310:x1876539541113472:12345-0@lo:400:kworker.0 Request processed in 84us (3495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607861.907783:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789607861.907837:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201878700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541113472:0@lo:400:kworker.0 00000100:00100000:3.0:1789607861.907967:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541113600:0@lo:400:kworker.0 00000100:00100000:3.0:1789607861.908004:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607861.909138:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541114112:0@lo:400:kworker.0 00000100:00100000:3.0:1789607861.909176:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607861.909210:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607861.909217:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541113728:0@lo:400:kworker.0 00000100:00100000:3.0:1789607861.909241:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607861.909284:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541114112 00000100:00100000:2.0:1789607861.909292:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541114112 00000100:00100000:2.0:1789607861.909345:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789607861.909353:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541114112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607861.909401:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541114112:12345-0@lo:400:kworker.0 Request processed in 49us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607861.909407:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1789607861.909452:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607861.916165:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789607861.916176:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789607861.916206:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541114112:0@lo:400:kworker.0 00000100:00100000:1.0:1789607861.922618:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541113600 00000100:00100000:1.0:1789607861.922634:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541113600 00000100:00100000:1.0:1789607861.922697:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541113728 00000100:00100000:1.0:1789607861.922701:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541113728 00000100:00100000:1.0:1789607861.922739:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789607861.922749:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c527dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541113600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607861.922838:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c527dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541113600:12345-0@lo:400:kworker.0 Request processed in 91us (14832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607861.922845:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789607861.922861:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789607861.922867:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541113728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607861.922891:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541113728:12345-0@lo:400:kworker.0 Request processed in 26us (13649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607861.922913:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:1.0:1789607861.922933:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607861.922971:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201879c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541113728:0@lo:400:kworker.0 00000100:00100000:1.0:1789607861.922984:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541113600:0@lo:400:kworker.0 00000001:02000400:3.0:1789607861.949842:0:12832:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 21:17:40 (1789607860) 00000100:00100000:0.0:1789607862.414593:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541114240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607862.414665:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607862.414761:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541114240 00000100:00100000:0.0:1789607862.414768:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541114240 00000100:00100000:0.0:1789607862.414808:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789607862.414817:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541114240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789607862.414848:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607862.414891:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541114240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607862.414898:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789607862.415153:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541114240:0@lo:13:osp-pre-1-0.0 00000020:00080000:2.0:1789607862.464477:0:5869:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:2.0:1789607862.464512:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1789607862.464655:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789607862.464671:0:5881:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789607862.680972:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607863.696454:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607863.950273:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607863.950312:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541114368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607863.950404:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607863.950506:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541114368 00000100:00100000:0.0:1789607863.950516:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541114368 00000100:00100000:0.0:1789607863.950589:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789607863.950599:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541114368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607863.950634:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607863.950678:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201879c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541114368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607863.950685:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1789607863.950705:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607863.950771:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541114368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607864.109351:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607864.109470:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520158976 00000100:00100000:0.0:1789607864.109480:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520158976 00000100:00100000:0.0:1789607864.109581:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 238 00000100:00100000:0.0:1789607864.109607:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:12340:x1876539520158976:12345-192.168.202.3@tcp:101:lsof.0 00010000:00010000:0.0:1789607864.109629:0:11489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607864.109651:0:11489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386ffa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9929 expref: -99 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607864.109713:0:11489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001387001 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607864.109728:0:11489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001387001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607864.109739:0:11489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001387001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607864.109772:0:11489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789607864.109776:0:11489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607864.109824:0:11489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001387001 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607864.109847:0:11489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d001386ffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9929 expref: 7 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607864.109864:0:11489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001387001 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9929 expref: 6 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607864.109872:0:11489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7dd00) 00010000:00010000:0.0:1789607864.109875:0:11489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607864.109879:0:11489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ade00, rc 0) 00000100:00100000:0.0:1789607864.110334:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:12340:x1876539520158976:12345-192.168.202.3@tcp:101:lsof.0 Request processed in 729us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607864.110354:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 238 00000100:00080000:1.0:1789607864.110467:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789607864.715735:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607865.720465:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607865.720644:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520159232 00000100:00100000:2.0:1789607865.720655:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520159232 00000100:00100000:2.0:1789607865.720736:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:2.0:1789607865.720747:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+18:12341:x1876539520159232:12345-192.168.202.3@tcp:35:umount.0 00000100:00080000:1.0:1789607865.720803:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607865.721296:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:12341:x1876539520159232:12345-192.168.202.3@tcp:35:umount.0 Request processed in 547us (874us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789607865.721304:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 66 00000100:00100000:3.0:1789607865.733163:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607865.735104:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520159488 00000100:00100000:2.0:1789607865.735120:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520159488 00000100:00100000:2.0:1789607865.735198:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 67 00000100:00100000:2.0:1789607865.735209:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+19:12341:x1876539520159488:12345-192.168.202.3@tcp:35:umount.0 00000100:00100000:2.0:1789607865.735741:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:12341:x1876539520159488:12345-192.168.202.3@tcp:35:umount.0 Request processed in 532us (2587us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1789607865.735750:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 67 00010000:00010000:0.0:1789607865.746725:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607865.764053:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607865.764164:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520159744 00000100:00100000:2.0:1789607865.764175:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520159744 00000100:00100000:2.0:1789607865.764237:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:2.0:1789607865.764246:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1db76f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+20:12341:x1876539520159744:12345-192.168.202.3@tcp:35:umount.0 00000100:00100000:2.0:1789607865.764519:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1db76f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:12341:x1876539520159744:12345-192.168.202.3@tcp:35:umount.0 Request processed in 274us (476us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789607865.764536:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 68 00000100:00100000:1.0:1789607865.778784:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607865.778900:0:12083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520160000 00000100:00100000:2.0:1789607865.778911:0:12083:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520160000 00000100:00100000:2.0:1789607865.779054:0:12083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:2.0:1789607865.779067:0:12083:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:12341:x1876539520160000:12345-192.168.202.3@tcp:35:umount.0 00000100:00100000:2.0:1789607865.780073:0:12083:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201878700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:12341:x1876539520160000:12345-192.168.202.3@tcp:35:umount.0 Request processed in 1005us (1371us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1789607865.780083:0:12083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 69 00000100:00100000:3.0:1789607865.795586:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607865.795657:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607865.795801:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520160128 00000100:00100000:1.0:1789607865.795812:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520160128 00000100:00100000:1.0:1789607865.795872:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520160256 00000100:00100000:1.0:1789607865.795875:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520160256 00000100:00100000:1.0:1789607865.795908:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:1.0:1789607865.795919:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dbac41d3-98d0-4271-a0dc-a31a8d191718+14:2373:x1876539520160128:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607865.795935:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607865.795954:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103be00/0x33f091d001386087 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94bb expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607865.795981:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607865.796039:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dbac41d3-98d0-4271-a0dc-a31a8d191718+13:2373:x1876539520160128:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 122us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607865.796048:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:1.0:1789607865.796072:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:1.0:1789607865.796079:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:2375:x1876539520160256:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607865.796087:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607865.796095:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167ce00/0x33f091d001385fed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9483 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607865.796105:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607865.796124:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:2375:x1876539520160256:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 46us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607865.796130:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:0.0:1789607865.804254:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607865.804372:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607865.804873:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520160384 00000100:00100000:1.0:1789607865.804884:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520160384 00000100:00100000:1.0:1789607865.804949:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:1.0:1789607865.804959:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:2375:x1876539520160384:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607865.804985:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607865.805006:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1f558e400/0x33f091d00138629b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9586 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607865.805023:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607865.805076:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2375:x1876539520160384:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 118us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607865.805083:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:2.0:1789607865.805220:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520160768 00000100:00100000:2.0:1789607865.805225:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520160768 00000100:00100000:2.0:1789607865.805274:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 72 00000100:00100000:2.0:1789607865.805281:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+7:2372:x1876539520160768:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:2.0:1789607865.805305:0:6694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d0013865c7 00000020:00010000:2.0:1789607865.805312:0:6694:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99a1ee950000: total 0 00000100:00080000:2.0:1789607865.805317:0:6694:0:(import.c:65:import_set_state_nolock()) ffff99a1ee956000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789607865.805351:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789607865.805648:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2372:x1876539520160768:12345-192.168.202.3@tcp:9:umount.0 Request processed in 366us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607865.805657:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 72 00000020:00010000:2.0:1789607865.805680:0:5835:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99a1ee950000: total 0 00010000:00010000:2.0:1789607865.805848:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99a1ee950000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789607865.805895:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c42f243b/0x33f091d001386963 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b975b expref: 4 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.805929:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006087e0f3/0x33f091d001386ff3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9922 expref: 3 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.805946:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99a1ee950000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789607865.805958:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607865.805960:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607865.805961:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789607865.806506:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789607865.815186:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607865.816053:0:8471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520160896 00000100:00100000:3.0:1789607865.816065:0:8471:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520160896 00000100:00100000:3.0:1789607865.816147:0:8471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 73 00000100:00100000:3.0:1789607865.816159:0:8471:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+5:2372:x1876539520160896:12345-192.168.202.3@tcp:9:umount.0 00000020:00000080:3.0:1789607865.816190:0:8471:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d00138635f 00000100:00080000:3.0:1789607865.816200:0:8471:0:(import.c:65:import_set_state_nolock()) ffff99a201b21800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789607865.816250:0:8471:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789607865.816686:0:8471:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+2:2372:x1876539520160896:12345-192.168.202.3@tcp:9:umount.0 Request processed in 528us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607865.816695:0:8471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 73 00010000:00010000:2.0:1789607865.816924:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789607865.816981:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607865.836057:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607865.836160:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520161920 00000100:00100000:1.0:1789607865.836170:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520161920 00000100:00100000:1.0:1789607865.836231:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 239 00000100:00100000:1.0:1789607865.836257:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+22:2372:x1876539520161920:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:1.0:1789607865.836294:0:6790:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385ffb 00000020:00010000:1.0:1789607865.836311:0:6790:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99a1fb24b800: total 0 00000100:00080000:1.0:1789607865.836315:0:6790:0:(import.c:65:import_set_state_nolock()) ffff99a1fb249000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789607865.836348:0:6790:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:1.0:1789607865.836768:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d0d9aceb-01dc-4deb-add2-cd492a0443a6+21:2372:x1876539520161920:12345-192.168.202.3@tcp:39:umount.0 Request processed in 511us (719us total) trans 4294967525 rc 0/0 00000020:00010000:2.0:1789607865.837226:0:5835:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99a1fb24b800: total 0 00010000:00010000:2.0:1789607865.837232:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607865.837271:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99a1fb24b800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789607865.837303:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:2.0:1789607865.837307:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789607865.837314:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e2400/0x33f091d001386fde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b991b expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837335:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:2.0:1789607865.837337:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607865.837340:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001386844 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b970e expref: 20 pid: 6790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837354:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:2.0:1789607865.837356:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607865.837360:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eee00/0x33f091d001386fb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b990d expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837388:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:2.0:1789607865.837391:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789607865.837395:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f200/0x33f091d001386335 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b95b0 expref: 18 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837407:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1f911d000) 00010000:00010000:2.0:1789607865.837409:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607865.837413:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013862e1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b959b expref: 17 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837474:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:2.0:1789607865.837477:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789607865.837481:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3800/0x33f091d001386cb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9849 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837494:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:2.0:1789607865.837496:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789607865.837500:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff7e3600/0x33f091d00138694e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9754 expref: 15 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837511:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a1f911dd00) 00010000:00010000:2.0:1789607865.837513:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607865.837518:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d001386ed4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b98d5 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837547:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a1c3982400) 00010000:00010000:2.0:1789607865.837550:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789607865.837560:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558fe00/0x33f091d0013869d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9777 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837578:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a1dab7d700) 00010000:00010000:2.0:1789607865.837580:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607865.837584:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001386924 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9746 expref: 12 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837599:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a1c3982100) 00010000:00010000:2.0:1789607865.837602:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789607865.837605:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1f558f400/0x33f091d001386622 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9682 expref: 11 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837618:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99a1dab7d000) 00010000:00010000:2.0:1789607865.837620:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607865.837624:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eea00/0x33f091d0013862c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9594 expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837638:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7dd00) 00010000:00010000:2.0:1789607865.837640:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607865.837644:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d0013869b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9770 expref: 9 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607865.837655:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99a1fb24b800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789607865.837667:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607865.837669:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607865.837671:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607865.837752:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 239 00000100:00100000:0.0:1789607866.160806:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607866.160920:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520162048 00000100:00100000:2.0:1789607866.160931:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520162048 00000100:00100000:2.0:1789607866.161037:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 172 00000100:00100000:2.0:1789607866.161047:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f61c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:2373:x1876539520162048:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607866.161169:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f61c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:2373:x1876539520162048:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 123us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607866.161177:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 172 00000100:00080000:1.0:1789607866.161307:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1789607866.571593:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000020:00000080:1.0:1789607866.571602:0:6718:0:(genops.c:885:class_export_put()) final put ffff99a201b25800/d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000020:00000080:0.0:1789607866.571686:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201b25800/d0d9aceb-01dc-4deb-add2-cd492a0443a6 for lustre-OST0000 00000020:00000080:0.0:1789607866.571746:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a201b21800 for lustre-OST0000 00010000:00010000:2.0:1789607866.763716:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607867.022691:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541114880:0@lo:400:kworker.0 00000100:00100000:3.0:1789607867.022768:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607867.022849:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789607867.022855:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541114496:0@lo:400:kworker.0 00000100:00100000:3.0:1789607867.022887:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607867.022913:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541115008:0@lo:400:kworker.0 00000100:00100000:3.0:1789607867.022938:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607867.022981:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541114496 00000100:00100000:3.0:1789607867.022988:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541114496 00000100:00100000:3.0:1789607867.023035:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789607867.023045:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541114496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607867.023097:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541114496:12345-0@lo:400:kworker.0 Request processed in 53us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607867.023104:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789607867.023157:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201879500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541114496:0@lo:400:kworker.0 00000100:00100000:2.0:1789607867.023340:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541114624:0@lo:400:kworker.0 00000100:00100000:2.0:1789607867.023373:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607867.023405:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541115136:0@lo:400:kworker.0 00000100:00100000:2.0:1789607867.023466:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607867.023483:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789607867.023489:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541114752:0@lo:400:kworker.0 00000100:00100000:2.0:1789607867.023508:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607867.023545:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541114880 00000100:00100000:2.0:1789607867.023549:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541114880 00000100:00100000:2.0:1789607867.023599:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541115136 00000100:00100000:2.0:1789607867.023603:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541115136 00000100:00100000:2.0:1789607867.023624:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789607867.023630:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541114880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607867.023670:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541114880:12345-0@lo:400:kworker.0 Request processed in 40us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607867.023676:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789607867.023689:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789607867.023694:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1d0d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541115136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607867.023723:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1d0d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541115136:12345-0@lo:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607867.023739:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1789607867.023756:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789607867.023760:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607867.023790:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541115136:0@lo:400:kworker.0 00000100:00100000:3.0:1789607867.024324:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541115008 00000100:00100000:3.0:1789607867.024330:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541115008 00000100:00100000:3.0:1789607867.024374:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541114624 00000100:00100000:3.0:1789607867.024378:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541114624 00000100:00100000:3.0:1789607867.024396:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541114752 00000100:00100000:3.0:1789607867.024400:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541114752 00000100:00100000:3.0:1789607867.024417:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789607867.024448:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541115008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607867.024490:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541115008:12345-0@lo:400:kworker.0 Request processed in 66us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607867.024496:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789607867.024521:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789607867.024529:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1facd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541114624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607867.024560:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1facd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541114624:12345-0@lo:400:kworker.0 Request processed in 32us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607867.024578:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789607867.024591:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789607867.024596:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541114752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607867.024621:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541114752:12345-0@lo:400:kworker.0 Request processed in 25us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607867.024626:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789607867.024657:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541115008:0@lo:400:kworker.0 00000100:00100000:3.0:1789607867.024668:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541114880:0@lo:400:kworker.0 00000100:00080000:2.0:1789607867.025717:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607867.025757:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201878000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541114752:0@lo:400:kworker.0 00000100:00100000:2.0:1789607867.025770:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201879180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541114624:0@lo:400:kworker.0 00000100:00100000:0.0:1789607867.534628:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ffafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541115264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607867.534702:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607867.535237:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541115264 00000100:00100000:3.0:1789607867.535247:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541115264 00000100:00100000:3.0:1789607867.535303:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789607867.535324:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ee292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541115264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607867.535357:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607867.535406:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ee292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541115264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607867.535413:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789607867.535628:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ffafce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541115264:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789607867.577787:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000020:00000080:2.0:1789607867.577797:0:7651:0:(genops.c:885:class_export_put()) final put ffff99a1ee950000/d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000020:00000080:2.0:1789607867.577825:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1ee950000/d0d9aceb-01dc-4deb-add2-cd492a0443a6 for lustre-OST0001 00000020:00000080:2.0:1789607867.577887:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1ee956000 for lustre-OST0001 00000001:00100000:3.0:1789607867.611765:0:5869:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000001:00080000:3.0:1789607867.611784:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1789607867.611801:0:5869:0:(genops.c:885:class_export_put()) final put ffff99a1fb24b800/d0d9aceb-01dc-4deb-add2-cd492a0443a6 00000020:00000080:0.0:1789607867.611906:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1fb24b800/d0d9aceb-01dc-4deb-add2-cd492a0443a6 for lustre-MDT0000 00000020:00000080:0.0:1789607867.611994:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1fb249000 for lustre-MDT0000 00010000:00010000:2.0:1789607867.788011:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607868.021102:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607868.021151:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607868.021196:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607868.021289:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520162176 00000100:00100000:2.0:1789607868.021293:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520162432 00000100:00100000:2.0:1789607868.021300:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520162432 00000100:00100000:1.0:1789607868.021300:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520162176 00000100:00100000:0.0:1789607868.021384:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520162304 00000100:00100000:0.0:1789607868.021389:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520162304 00000100:00100000:2.0:1789607868.021512:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:2.0:1789607868.021523:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+12:2373:x1876539520162432:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607868.021538:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607868.021558:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103ae00/0x33f091d001386294 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b957f expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607868.021575:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607868.021626:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:2373:x1876539520162432:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 105us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607868.021634:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:1.0:1789607868.024939:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:1.0:1789607868.025686:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dbac41d3-98d0-4271-a0dc-a31a8d191718+11:2373:x1876539520162176:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607868.025705:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607868.025741:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103ba00/0x33f091d0013860cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94d0 expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607868.025758:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607868.025829:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dbac41d3-98d0-4271-a0dc-a31a8d191718+10:2373:x1876539520162176:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 160us (4739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607868.025837:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:2.0:1789607868.026091:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:2.0:1789607868.026115:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+8:2373:x1876539520162304:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789607868.026124:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607868.026134:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167c400/0x33f091d0013860d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94fa expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607868.026145:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607868.026167:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dbac41d3-98d0-4271-a0dc-a31a8d191718+7:2373:x1876539520162304:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 55us (4970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607868.026174:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:3.0:1789607868.032351:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607868.033031:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520162688 00000100:00100000:3.0:1789607868.033040:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520162688 00000100:00100000:3.0:1789607868.033107:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 240 00000100:00100000:3.0:1789607868.033117:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+6:2372:x1876539520162688:12345-192.168.202.3@tcp:39:umount.0 00000020:00000080:3.0:1789607868.033156:0:5848:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d0013860e2 00000020:00010000:3.0:1789607868.033165:0:5848:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99a1f500e000: total 0 00000100:00080000:3.0:1789607868.033170:0:5848:0:(import.c:65:import_set_state_nolock()) ffff99a1f500d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789607868.033195:0:5848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1789607868.034102:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1d227a0f-0368-435f-aa0d-1a7ac54e4639+5:2372:x1876539520162688:12345-192.168.202.3@tcp:39:umount.0 Request processed in 982us (1758us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789607868.034605:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 240 00000020:00010000:3.0:1789607868.034679:0:5836:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99a1f500e000: total 0 00010000:00010000:3.0:1789607868.034721:0:5836:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99a1f500e000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789607868.034755:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1dab7dd00) 00010000:00010000:3.0:1789607868.034759:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607868.034783:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ade00/0x33f091d001387001 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9929 expref: 4 pid: 11489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607868.034807:0:5836:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99a1f500e000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789607868.034819:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607868.034822:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607868.034823:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789607868.035139:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607868.058927:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607868.059617:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520162944 00000100:00100000:0.0:1789607868.059628:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520162944 00000100:00100000:0.0:1789607868.059692:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 305 00000100:00100000:0.0:1789607868.059703:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+7:2372:x1876539520162944:12345-192.168.202.3@tcp:251:umount.0 00000020:00000080:0.0:1789607868.059750:0:5842:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385fd8 00000020:00010000:0.0:1789607868.059758:0:5842:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99a0c1ce2800: total 0 00000100:00080000:0.0:1789607868.059763:0:5842:0:(import.c:65:import_set_state_nolock()) ffff99a0c1ce5800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789607868.059863:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dbac41d3-98d0-4271-a0dc-a31a8d191718+3:2372:x1876539520162944:12345-192.168.202.3@tcp:251:umount.0 Request processed in 160us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607868.059887:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 305 00000020:00010000:2.0:1789607868.064237:0:5835:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99a0c1ce2800: total 0 00010000:00010000:2.0:1789607868.064249:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607868.064312:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99a0c1ce2800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789607868.064355:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1f558e600/0x33f091d00138608e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b94c2 expref: 2 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607868.064374:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99a0c1ce2800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789607868.064384:0:5835:0:(genops.c:885:class_export_put()) final put ffff99a0c1ce2800/dbac41d3-98d0-4271-a0dc-a31a8d191718 00010000:00010000:2.0:1789607868.064412:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607868.064414:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607868.064416:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789607868.064551:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99a0c1ce2800/dbac41d3-98d0-4271-a0dc-a31a8d191718 for MGS 00000020:00000080:1.0:1789607868.064588:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a0c1ce5800 for MGS 00000040:00080000:3.0:1789607868.748737:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789607868.748747:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607868.749268:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789607868.749276:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789607868.811621:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607869.068111:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541115392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607869.068186:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607869.068260:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541115392 00000100:00100000:3.0:1789607869.068268:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541115392 00000100:00080000:0.0:1789607869.070568:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607869.070681:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789607869.070699:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541115392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607869.070737:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607869.070816:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541115392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (2630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607869.070824:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789607869.071545:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541115392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789607869.836020:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789607869.838586:0:13033:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789607869.852572:0:13033:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789607869.852623:0:13033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.852639:0:13033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.852648:0:13033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.852667:0:13033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.852688:0:13033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789607869.852694:0:13033:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789607869.852720:0:13033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789607869.852724:0:13033:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789607869.852729:0:13033:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789607869.852752:0:13033:0:(import.c:65:import_set_state_nolock()) ffff99a1ee447000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789607869.852876:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607869.852884:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.852902:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558fa00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607869.852906:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.852915:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607869.852922:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607869.852928:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789607869.852930:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789607869.852933:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789607869.852973:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.852980:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607869.853008:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.853016:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1f558fa00/0x33f091d00138605d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001386064 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.853029:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607869.853031:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607869.853033:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607869.853050:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876539541115520:0@lo:39:umount.0 00000100:00100000:3.0:1789607869.853122:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607869.853189:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607869.853204:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541115648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607869.853234:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607869.853269:0:6790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541115520 00000100:00100000:3.0:1789607869.853276:0:6790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541115520 00000100:00100000:3.0:1789607869.853319:0:6790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789607869.853328:0:6790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876539541115520:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789607869.853353:0:6790:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385de7 00000100:00080000:3.0:1789607869.853362:0:6790:0:(import.c:65:import_set_state_nolock()) ffff99a1ee1a6000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789607869.853417:0:6790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3308:x1876539541115520:12345-0@lo:39:umount.0 Request processed in 89us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607869.853450:0:6790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:3.0:1789607869.853461:0:6790:0:(genops.c:885:class_export_put()) final put ffff99a1ee1a4000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:3.0:1789607869.853497:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541115648 00000100:00100000:3.0:1789607869.853501:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541115648 00000100:00100000:3.0:1789607869.853543:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789607869.853550:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2703100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3309:x1876539541115648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607869.853561:0:8517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607869.853576:0:8517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103ac00/0x33f091d001386064 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d00138605d expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.853587:0:8517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607869.853616:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2703100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:3309:x1876539541115648:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607869.853622:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789607869.853659:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1ee447000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789607869.853668:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876539541115520:0@lo:39:umount.0 00000020:00000080:3.0:1789607869.853688:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1ee1a4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789607869.853745:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1ee1a6000 for lustre-MDT0000 00000100:00100000:3.0:1789607869.853768:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541115648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607869.853785:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789607869.853890:0:13033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789607869.853893:0:13033:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789607869.853897:0:13033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789607869.854807:0:13033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854820:0:13033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854828:0:13033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854834:0:13033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854851:0:13033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607869.854856:0:13033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854877:0:13033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854883:0:13033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854889:0:13033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854899:0:13033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789607869.854905:0:13033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854911:0:13033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854917:0:13033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854923:0:13033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854929:0:13033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789607869.854933:0:13033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ec00/0x33f091d001385d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854939:0:13033:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ec00/0x33f091d001385d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854953:0:13033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ec00/0x33f091d001385d46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854959:0:13033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ec00/0x33f091d001385d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607869.854966:0:13033:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1789607869.854968:0:13033:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789607869.854989:0:13033:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789607869.854993:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789607869.854997:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607869.855002:0:13033:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1789607869.855007:0:13033:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99a1e4ce5000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789607869.855013:0:13033:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff99a1ff53e800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789607869.855019:0:13033:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff99a1f500e000 1d227a0f-0368-435f-aa0d-1a7ac54e4639 192.168.202.3@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789607869.855024:0:13033:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff99a1c65d8000) has exports, disconnecting them 00000020:00080000:2.0:1789607869.855028:0:13033:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99a1e4ce5000), last request at 1789607867 00000020:00000080:2.0:1789607869.855034:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385f5a 00000100:00080000:2.0:1789607869.855051:0:13033:0:(import.c:65:import_set_state_nolock()) ffff99a1e4ce6800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789607869.855091:0:13033:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99a1e4ce5000): rc 0 00000020:00000080:2.0:1789607869.855094:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a1e4ce5000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789607869.855101:0:13033:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99a1ff53e800), last request at 1789607867 00000020:00000080:2.0:1789607869.855105:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385e8f 00000100:00080000:2.0:1789607869.855109:0:13033:0:(import.c:65:import_set_state_nolock()) ffff99a1ff53b000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789607869.855114:0:13033:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99a1ff53e800): rc 0 00000020:00000080:2.0:1789607869.855116:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a1ff53e800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1789607869.855122:0:13033:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb85e83c33ae0 00000100:00080000:2.0:1789607869.855144:0:13033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789607869.855148:0:13033:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1789607869.855159:0:13033:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789607869.855226:0:13033:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789607869.855243:0:13033:0:(import.c:65:import_set_state_nolock()) ffff99a1e4ce4000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789607869.855255:0:13033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789607869.855257:0:13033:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1789607869.855264:0:13033:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789607869.855319:0:13033:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789607869.855327:0:13033:0:(import.c:65:import_set_state_nolock()) ffff99a1e4ce3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789607869.855355:0:13033:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99a1c65d8000) has no exports 00010000:00010000:3.0:1789607869.858746:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789607869.858760:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.858774:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1511000 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607869.858778:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.858791:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607869.858800:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607869.858807:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789607869.858810:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1789607869.858813:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1789607869.858852:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.858860:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607869.858899:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.858908:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c1511000/0x33f091d00138606b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001386072 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.858925:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789607869.858938:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.858944:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c167ca00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607869.858947:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.858954:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607869.858959:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607869.858964:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789607869.858966:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789607869.858968:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789607869.858983:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.858988:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607869.858994:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.859000:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c167ca00/0x33f091d001385f92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001385f99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.859014:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789607869.859017:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.859023:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f600 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607869.859031:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.859038:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607869.859044:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607869.859050:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789607869.859052:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789607869.859054:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789607869.859065:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.859071:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607869.859086:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.859093:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1f558f600/0x33f091d001386286 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d00138628d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.859104:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607869.859108:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ec00/0x33f091d001385d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.859113:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d8d7ec00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:3.0:1789607869.859116:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ec00/0x33f091d001385d46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.859122:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ec00/0x33f091d001385d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789607869.859134:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ec00/0x33f091d001385d46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607869.859139:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789607869.859141:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789607869.859143:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789607869.859155:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ec00/0x33f091d001385d46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.859160:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789607869.859166:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ec00/0x33f091d001385d46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.859171:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d8d7ec00/0x33f091d001385d46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001385d4d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.859184:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607869.859186:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607869.859188:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789607869.859199:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1e4ce5000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789607869.859243:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1ff53e800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789607869.859264:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1e4ce6800 for lustre-MDT0000 00000020:00000080:3.0:1789607869.859268:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1ff53b000 for lustre-MDT0000 00000100:00100000:3.0:1789607869.859289:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541115776:0@lo:9:umount.0 00000100:00100000:3.0:1789607869.859353:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607869.859386:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541115904:0@lo:9:umount.0 00000100:00100000:3.0:1789607869.859409:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607869.859623:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541116160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607869.859660:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607869.859690:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789607869.859696:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541116032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607869.859714:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607869.859739:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541116288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607869.859760:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607869.859777:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607869.859781:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541116416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607869.859799:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607869.859832:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541115776 00000100:00100000:3.0:1789607869.859840:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541115776 00000100:00100000:3.0:1789607869.859883:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541115904 00000100:00100000:3.0:1789607869.859887:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541115904 00000100:00100000:3.0:1789607869.859920:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789607869.859929:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876539541115776:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789607869.859956:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385edc 00000100:00080000:3.0:1789607869.859966:0:6692:0:(import.c:65:import_set_state_nolock()) ffff99a1f61b5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789607869.859996:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789607869.860358:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3308:x1876539541115776:12345-0@lo:9:umount.0 Request processed in 429us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607869.860366:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789607869.860383:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789607869.860389:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876539541115904:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789607869.860402:0:6692:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385fc3 00000100:00080000:3.0:1789607869.860407:0:6692:0:(import.c:65:import_set_state_nolock()) ffff99a1f500d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789607869.860441:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789607869.866750:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3308:x1876539541115904:12345-0@lo:9:umount.0 Request processed in 6129us (7108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607869.866774:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789607869.866817:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541116160 00000100:00100000:3.0:1789607869.866825:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541116160 00000100:00100000:3.0:1789607869.866858:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541116032 00000100:00100000:3.0:1789607869.866862:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541116032 00000100:00100000:3.0:1789607869.866874:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541116288 00000100:00100000:3.0:1789607869.866877:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541116288 00000100:00100000:3.0:1789607869.866888:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541116416 00000100:00100000:3.0:1789607869.866891:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541116416 00000100:00100000:3.0:1789607869.866906:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789607869.866915:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2700700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+21:3312:x1876539541116160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607869.866929:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607869.866947:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1f558ec00/0x33f091d001385f99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d001385f92 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.866965:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607869.867053:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2700700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+20:3312:x1876539541116160:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (7391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607869.867060:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789607869.867072:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789607869.867078:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2700000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+19:3312:x1876539541116032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607869.867086:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607869.867094:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103b200/0x33f091d001386072 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d00138606b expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.867103:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607869.867125:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2700000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+18:3312:x1876539541116032:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (7410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607869.867139:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789607869.867153:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789607869.867159:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2701c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+17:3309:x1876539541116288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607869.867166:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607869.867173:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d103aa00/0x33f091d00138628d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d001386286 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.867182:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607869.867212:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2701c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+16:3309:x1876539541116288:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (7451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607869.867217:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789607869.867228:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789607869.867233:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2703800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+15:3309:x1876539541116416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607869.867243:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607869.867250:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c1511400/0x33f091d001385d4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d001385d46 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607869.867260:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607869.867281:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2703800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:3309:x1876539541116416:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (7481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607869.867285:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789607869.867314:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607869.873038:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541116160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607869.873077:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541116032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607869.873848:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607869.873856:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789607869.873896:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1e4ce4000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789607869.873917:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789607869.873919:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789607869.873924:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541115776:0@lo:9:umount.0 00000100:00080000:0.0:1789607869.873938:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1e4ce3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789607869.873955:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789607869.873957:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789607869.873960:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541115904:0@lo:9:umount.0 00000100:00100000:0.0:1789607869.874002:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541116416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607869.874012:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:3309:1876539541116288:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789607869.888037:0:13033:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff99a1c65d8000) has no exports 00000020:00000080:2.0:1789607869.950770:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385da1 00000020:00000080:2.0:1789607869.950788:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a20169f000/lustre-QMT0000_UUID 00000020:01000000:2.0:1789607869.950860:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789607869.951495:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607869.951508:0:13033:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789607869.951513:0:13033:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff99a1f61a0000) has no exports 00000020:00000080:0.0:1789607869.951828:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385d9a 00000020:00000080:0.0:1789607869.951835:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a1f61b7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789607869.951891:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99a20169f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789607869.953099:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607869.953112:0:13033:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789607869.953117:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a201cfe800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789607869.953121:0:13033:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201cfe800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789607869.953132:0:13033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1789607869.953356:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1f61b7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789607870.861455:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789607871.731241:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789607871.731251:0:6718:0:(genops.c:885:class_export_put()) final put ffff99a201cc4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789607871.731455:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201cc4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789607871.731543:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1f61b5800 for lustre-OST0000 00010000:00010000:0.0:1789607871.888092:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607872.139948:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541116800:0@lo:400:kworker.0 00000100:00100000:0.0:1789607872.140026:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607872.140126:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541116800 00000100:00100000:0.0:1789607872.140134:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541116800 00000100:00100000:0.0:1789607872.140176:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789607872.140184:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3309:x1876539541116800:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789607872.140192:0:11489:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789607872.140233:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3309:x1876539541116800:12345-0@lo:400:kworker.0 Request processed in 49us (207us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789607872.140240:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:0.0:1789607872.140279:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789607872.140284:0:3309:0:(import.c:65:import_set_state_nolock()) ffff99a1f500b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789607872.140288:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1789607872.140726:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541116672:0@lo:400:kworker.0 00000100:00100000:1.0:1789607872.140769:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607872.140805:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607872.140811:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ee292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541116544:0@lo:400:kworker.0 00000100:00100000:1.0:1789607872.140839:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607872.140869:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541116672 00000100:00100000:1.0:1789607872.140873:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541116672 00000100:00100000:1.0:1789607872.140898:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789607872.140903:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876539541116672:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789607872.140907:0:5849:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789607872.140936:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1876539541116672:12345-0@lo:400:kworker.0 Request processed in 32us (167us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789607872.140941:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789607872.140959:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541116544 00000100:00100000:1.0:1789607872.140963:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541116544 00000100:00100000:1.0:1789607872.140988:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789607872.140995:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f92fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:3312:x1876539541116544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607872.141030:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f92fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d7ee8c63-baa9-4366-97c9-8054ab743e80+14:3312:x1876539541116544:12345-0@lo:400:kworker.0 Request processed in 36us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607872.141036:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789607872.141073:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ee292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d7ee8c63-baa9-4366-97c9-8054ab743e80:3312:1876539541116544:0@lo:400:kworker.0 00000100:00080000:1.0:1789607872.141083:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789607872.141086:0:3312:0:(import.c:65:import_set_state_nolock()) ffff99a201cc1000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789607872.141090:0:3312:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789607872.141094:0:3312:0:(import.c:65:import_set_state_nolock()) ffff99a201cc1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607872.141098:0:3312:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 186 00000100:00080000:1.0:1789607872.141115:0:3312:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99a201cc1000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1789607872.141138:0:3312:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a20187a300 x1876539541116928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607872.141167:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541116672:0@lo:400:kworker.0 00000100:00100000:3.0:1789607872.143779:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876539541116928:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789607872.143865:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607872.146721:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541116928 00000100:00100000:2.0:1789607872.146740:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541116928 00000100:00100000:2.0:1789607872.146800:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789607872.146809:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876539541116928:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1789607872.146829:0:5847:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789607872.158414:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876539541116928:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 11598us (14542us total) trans 0 rc -19/-19 00000100:00080000:3.0:1789607872.158575:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a201cc1000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607872.158584:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789607872.158590:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876539541116928:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1789607872.161204:0:3309:0:(import.c:65:import_set_state_nolock()) ffff99a1f500b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607872.161221:0:3309:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 208 00000100:00080000:0.0:1789607872.161241:0:3309:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99a1f500b800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1789607872.161292:0:3309:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2704700 x1876539541117056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607872.161368:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876539541117056:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1789607872.161475:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607872.162188:0:11489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541117056 00000100:00100000:1.0:1789607872.162197:0:11489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541117056 00000100:00100000:1.0:1789607872.162253:0:11489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789607872.162262:0:11489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3308:x1876539541117056:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1789607872.162283:0:11489:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789607872.162572:0:11489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3308:x1876539541117056:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 308us (1095us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789607872.162580:0:11489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1789607872.162812:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1f500b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607872.162818:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789607872.162823:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876539541117056:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1789607872.165411:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541116800:0@lo:400:kworker.0 00000100:00100000:2.0:1789607872.165509:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000001:00100000:1.0:1789607872.726076:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789607872.726085:0:7651:0:(genops.c:885:class_export_put()) final put ffff99a1f5009000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789607872.726164:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1f5009000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789607872.726217:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1f500d800 for lustre-OST0001 00000001:00100000:3.0:1789607872.737390:0:5869:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1d227a0f-0368-435f-aa0d-1a7ac54e4639 00000001:00080000:3.0:1789607872.737465:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1789607872.737472:0:5869:0:(genops.c:885:class_export_put()) final put ffff99a1f500e000/1d227a0f-0368-435f-aa0d-1a7ac54e4639 00000020:00000080:0.0:1789607872.737600:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1f500e000/1d227a0f-0368-435f-aa0d-1a7ac54e4639 for lustre-MDT0000 00000020:00000080:0.0:1789607872.737791:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1f500d000 for lustre-MDT0000 00010000:00010000:0.0:1789607872.907815:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607873.931878:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607874.955727:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607875.982774:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789607876.043637:0:13033:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a1fb3fa2a0 - data ffff99a1ffdcd870/ffff99a1eeb20800 00000020:01000000:0.0:1789607876.043781:0:13033:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a1f61ac300 - data ffff99a1c9041d80/ffff99a1f6097400 00000001:00000004:0.0:1789607876.053778:0:13033:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1789607876.150455:0:13033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789607876.150465:0:13033:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1789607876.150486:0:13033:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789607876.150489:0:13033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789607876.151334:0:6787:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789607876.151340:0:6787:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1789607876.151352:0:6787:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789607876.152641:0:13033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789607876.152647:0:13033:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1789607876.152669:0:13033:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789607876.152672:0:13033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789607876.152929:0:7981:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789607876.152945:0:7981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1789607876.152956:0:7981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789607876.210457:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385d69 00000020:00000080:1.0:1789607876.210474:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a201cc3800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789607876.211973:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385d7e 00000020:00000080:1.0:1789607876.211989:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a201cfe000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789607876.211998:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789607876.212006:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607876.212017:0:13033:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789607876.212023:0:13033:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff99a1c65db380) has no exports 00000004:01000000:1.0:1789607876.212193:0:13033:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789607876.212204:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385fbc 00000020:00000080:1.0:1789607876.212210:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a0c1ce3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789607876.212214:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789607876.212228:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607876.212235:0:13033:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789607876.212237:0:13033:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff99a1f61a3380) has no exports 00000020:00000080:1.0:1789607876.212245:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385fb5 00000020:00000080:1.0:1789607876.212248:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a1e4ce2800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789607876.212659:0:13033:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789607876.212665:0:13033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789607876.212670:0:13033:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789607876.212677:0:13033:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789607876.212680:0:13033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789607876.212725:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607876.212734:0:13033:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789607876.212740:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385ed5 00000020:00000080:1.0:1789607876.212745:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a1ff539800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789607876.212749:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789607876.212754:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607876.212758:0:13033:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789607876.212760:0:13033:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff99a1ff848000) has no exports 00000020:00000080:1.0:1789607876.212765:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385ece 00000020:00000080:1.0:1789607876.212769:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a1e4ce2000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789607876.213139:0:13033:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789607876.213143:0:13033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789607876.213145:0:13033:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789607876.213149:0:13033:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789607876.213150:0:13033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789607876.213173:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607876.213178:0:13033:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789607876.213205:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607876.213208:0:13033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789607876.213238:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385d85 00000020:00000080:1.0:1789607876.213244:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a201cf8000/lustre-MDD0000_UUID 00000020:01000000:1.0:1789607876.213248:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789607876.213258:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607876.213262:0:13033:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789607876.213265:0:13033:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff99a1c65dcd40) has no exports 00000020:00000080:1.0:1789607876.213288:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607876.213291:0:13033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789607876.213295:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385d8c 00000020:00000080:1.0:1789607876.213298:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a201cf8800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789607876.213306:0:13033:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a1c98a7800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789607876.213310:0:13033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a1c98a7800 3 00000020:01000004:1.0:1789607876.213313:0:13033:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99a1c98a7800 from lustre-MDT0000 00000020:00000080:1.0:1789607876.213337:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607876.213340:0:13033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789607876.213343:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a201cc1800/lustre-MDT0000_UUID 00000020:00000080:1.0:1789607876.213346:0:13033:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201cc1800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789607876.213355:0:13033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789607876.213419:0:13033:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:00000080:0.0:1789607876.213893:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201cc3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789607876.213910:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201cfe000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789607876.213913:0:8:0:(genops.c:885:class_export_put()) final put ffff99a201cc2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789607876.213915:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201cc2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789607876.213919:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789607876.214053:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a0c1ce3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789607876.214060:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1e4ce2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789607876.214066:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1e4ce3800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789607876.214073:0:8:0:(genops.c:885:class_export_put()) final put ffff99a1f500f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789607876.214075:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1f500f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789607876.214078:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789607876.214110:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1ff539800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789607876.214116:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1e4ce2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789607876.214120:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1e4ce4000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789607876.214124:0:8:0:(genops.c:885:class_export_put()) final put ffff99a1e4ce1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789607876.214126:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1e4ce1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789607876.214130:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789607876.214200:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201cf8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789607876.214204:0:8:0:(genops.c:885:class_export_put()) final put ffff99a201cc2800/lustre-MDD0000_UUID 00000020:00000080:0.0:1789607876.214206:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201cc2800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789607876.214209:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789607876.214393:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201cf8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1789607876.214995:0:13033:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789607876.215000:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789607876.215006:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607876.215011:0:13033:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789607876.215018:0:13033:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff99a1d0ab0800 d7ee8c63-baa9-4366-97c9-8054ab743e80 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789607876.215025:0:13033:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff99a1e4cdcd40) has exports, disconnecting them 00000020:00080000:1.0:1789607876.215030:0:13033:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99a1d0ab0800), last request at 1789607634 00000020:00000080:1.0:1789607876.215046:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385d2a 00000020:00010000:1.0:1789607876.215052:0:13033:0:(genops.c:1920:obd_stale_export_put()) Put export ffff99a1d0ab0800: total 0 00000100:00080000:1.0:1789607876.215056:0:13033:0:(import.c:65:import_set_state_nolock()) ffff99a1d0ab4000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789607876.215216:0:13033:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99a1d0ab0800): rc 0 00000020:00080000:1.0:1789607876.215221:0:13033:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff99a1e4cdcd40) has no exports 00000100:00100000:1.0:1789607876.215290:0:5839:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff99a1c9d1cc00:5839] 0 exiting: rc = 1 00000100:00100000:0.0:1789607876.215487:0:5841:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff99a1c9d1d000:5841] 1 exiting: rc = 0 00000020:00010000:2.0:1789607876.215814:0:5836:0:(genops.c:1906:obd_stale_export_get()) Get export ffff99a1d0ab0800: total 0 00010000:00010000:2.0:1789607876.215854:0:5836:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99a1d0ab0800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1789607876.215885:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1d8d7fc00/0x33f091d001385e42 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d001385e3b expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607876.215906:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c1510200/0x33f091d001386080 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d001386079 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607876.215917:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167d400/0x33f091d00138603a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d001386033 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607876.215927:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c1511e00/0x33f091d00138602c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d001386025 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607876.215940:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c1510a00/0x33f091d001386048 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d001386041 expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607876.215950:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1c167cc00/0x33f091d001386056 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d00138604f expref: 4 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607876.215964:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff7e2000/0x33f091d00138627f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d001386278 expref: 3 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607876.215975:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1f558e200/0x33f091d001386271 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x33f091d00138626a expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607876.215985:0:5836:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99a1d0ab0800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1789607876.215996:0:5836:0:(genops.c:885:class_export_put()) final put ffff99a1d0ab0800/d7ee8c63-baa9-4366-97c9-8054ab743e80 00010000:00010000:2.0:1789607876.216048:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607876.216060:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607876.216062:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607876.216151:0:5842:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff99a1c9d1d200:5842] 2 exiting: rc = 0 00000100:00100000:1.0:1789607876.216734:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216743:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216750:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216766:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216772:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216778:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216784:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216790:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216797:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216804:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216810:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216817:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216824:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216832:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216837:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216845:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216852:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216859:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216865:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216871:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216877:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216883:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216889:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216895:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216901:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216907:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216913:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216919:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216925:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216932:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216938:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216943:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216949:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216955:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216961:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216966:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216973:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216978:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216992:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.216997:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217004:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217010:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217017:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217023:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217029:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217035:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217041:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217046:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217051:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217057:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217063:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217068:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217073:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217078:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217084:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217090:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217095:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217101:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217106:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217112:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217118:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217124:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217130:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.217135:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789607876.217820:0:13033:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789607876.217825:0:13033:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1789607876.221114:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1d0ab0800/d7ee8c63-baa9-4366-97c9-8054ab743e80 for MGS 00000020:00000080:0.0:1789607876.221169:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1d0ab4000 for MGS 00000020:01000000:1.0:1789607876.221274:0:13033:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a1d20af4e0 - data ffff99a1ffc9d870/ffff99a1f5003400 00000020:01000000:0.0:1789607876.224356:0:13033:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a1e8d14360 - data ffff99a1c902e0d8/ffff99a1e8cfb000 00000020:00000080:0.0:1789607876.225298:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385d0e 00000020:00000080:0.0:1789607876.225310:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a1d0ab1000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789607876.225340:0:13033:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a1c98a7800 from MGS, refs=2 00000020:01000004:0.0:1789607876.225344:0:13033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a1c98a7800 2 00000020:01000004:0.0:1789607876.225348:0:13033:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99a1c98a7800 from MGS 00000020:00000080:1.0:1789607876.225493:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1d0ab1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789607876.225644:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607876.225653:0:13033:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789607876.225657:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a1d0ab3800/MGS 00000020:00000080:0.0:1789607876.225659:0:13033:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1d0ab3800/MGS for MGS 00000020:01000000:0.0:1789607876.225666:0:13033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789607876.225729:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789607876.225733:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607876.225738:0:13033:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789607876.225745:0:13033:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99a1ee441800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789607876.225751:0:13033:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff99a1e4cd99c0) has exports, disconnecting them 00000020:00080000:0.0:1789607876.225758:0:13033:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99a1ee441800), last request at 1789607635 00000020:00000080:0.0:1789607876.225765:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385dd9 00000020:00080000:0.0:1789607876.225777:0:13033:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99a1ee441800): rc 0 00000020:00000080:0.0:1789607876.225783:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a1ee441800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789607876.227320:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1ee441800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789607876.227905:0:13033:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789607876.227911:0:13033:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789607876.227916:0:13033:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789607876.227935:0:13033:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789607876.228121:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607876.228130:0:13033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789607876.228137:0:13033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a1c98a7800 1 00000020:00000080:1.0:1789607876.228143:0:13033:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385d00 00000020:00000080:1.0:1789607876.228151:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a1d0ab1800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789607876.228156:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789607876.228161:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607876.228164:0:13033:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789607876.228167:0:13033:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff99a1e4cd8000) has no exports 00000020:00000080:2.0:1789607876.228234:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1ee447000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789607876.228242:0:37:0:(genops.c:885:class_export_put()) final put ffff99a1ee443000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789607876.228244:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1ee443000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789607876.228254:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789607876.228306:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1d0ab1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789607876.286076:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607876.286096:0:13033:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789607876.286104:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a1d8794000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789607876.286110:0:13033:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1d8794000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789607876.286119:0:13033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789607876.286271:0:13033:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99a1d3628800 00000020:01000000:1.0:1789607876.286305:0:13033:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789607876.286310:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607876.286315:0:13033:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789607876.286319:0:13033:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff99a1c65d99c0) has no exports 00000100:00100000:2.0:1789607876.289648:0:5847:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff99a1f9297a00:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1789607876.290047:0:11489:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff99a1c8f0e200:11489] 4 exiting: rc = 0 00000100:00100000:1.0:1789607876.290148:0:5849:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff99a1c8f5d800:5849] 2 exiting: rc = 0 00000100:00100000:3.0:1789607876.295664:0:6790:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff99a1e8d9bc00:6790] 3 exiting: rc = 0 00000100:00100000:3.0:1789607876.295847:0:5848:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff99a1f9297600:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1789607876.296181:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296190:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296196:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296202:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296208:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296214:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296220:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296227:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296232:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296238:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296243:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296248:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296255:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296261:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296268:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296274:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296280:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296287:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296294:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296300:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296306:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296312:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296319:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296326:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296332:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296353:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296362:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296369:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296376:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296382:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296404:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296412:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296418:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296469:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296477:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296485:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296491:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296497:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296504:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296512:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296520:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296528:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296535:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296540:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296546:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296552:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296559:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296566:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296572:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296579:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296586:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296592:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296598:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296605:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296611:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296617:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296622:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296628:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296633:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296639:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296653:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296659:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296665:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.296671:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.301949:0:12083:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff99a0c307fe00:12083] 2 exiting: rc = 0 00000100:00100000:1.0:1789607876.303455:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99a1c8f5de00:5851] 1 exiting: rc = 0 00000100:00100000:1.0:1789607876.305287:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99a1c8f5ce00:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1789607876.305473:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305484:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305491:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305498:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305505:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305511:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305518:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305525:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305532:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305537:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305544:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305551:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305559:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305564:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305569:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305574:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305579:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305585:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305591:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305596:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305601:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305607:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305612:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305617:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305623:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305627:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305632:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305637:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305643:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305649:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305669:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305674:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305679:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305684:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305689:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305694:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305699:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305704:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305710:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305715:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305721:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305725:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305731:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305736:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305741:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305747:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305752:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305758:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305763:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305768:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305773:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305777:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305782:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305787:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305791:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305797:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305801:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305806:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305811:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305816:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305821:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305826:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305831:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.305838:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.306688:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff99a1c8e19e00:5852] 0 exiting: rc = 1 00000100:00100000:0.0:1789607876.307326:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff99a1c8e18e00:5853] 1 exiting: rc = 0 00000100:00100000:3.0:1789607876.307935:0:12495:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff99a1ee197000:12495] 2 exiting: rc = 0 00000100:00100000:2.0:1789607876.308499:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308519:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308536:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308544:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308551:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308557:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308563:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308570:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308576:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308582:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308589:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308594:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308600:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308607:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308613:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308635:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308645:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308652:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308657:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308663:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308671:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308677:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308684:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308692:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308698:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308704:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308710:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308731:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308739:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308745:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308752:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308758:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308764:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308770:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308776:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308783:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308797:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308804:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308811:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308830:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308837:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308842:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308849:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308855:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308860:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308866:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308872:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308878:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308885:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308890:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308897:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308915:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308922:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308928:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.308934:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.309130:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.309140:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.309145:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.309151:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.309157:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.309163:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.309168:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.309175:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.309192:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.333099:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99a1c8e18800:5854] 0 exiting: rc = 1 00000100:00100000:2.0:1789607876.333342:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99a1f9297400:5855] 1 exiting: rc = 0 00000100:00100000:2.0:1789607876.333403:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333411:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333416:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333481:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333488:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333494:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333510:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333515:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333520:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333604:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333611:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333616:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333621:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333626:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333631:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333635:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333640:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333645:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333649:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333654:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333658:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333662:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333667:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333672:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333677:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333681:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333686:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333690:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333695:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333701:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333705:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333710:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333714:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333719:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333724:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333729:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333733:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333739:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333743:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333748:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333753:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333766:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333771:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333776:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333781:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333785:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333789:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333794:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333799:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333803:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333808:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333813:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333817:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333822:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333827:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333832:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333837:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333842:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333847:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333852:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333856:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333861:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333866:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.333871:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.334886:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99a1e8efc000:5857] 1 exiting: rc = 0 00000100:00100000:2.0:1789607876.335087:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99a1c8e19400:5856] 0 exiting: rc = 1 00000100:00100000:2.0:1789607876.335140:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335147:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335152:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335157:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335162:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335167:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335173:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335178:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335184:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335190:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335196:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335212:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335218:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335223:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335229:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335233:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335239:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335245:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335251:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335257:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335262:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335268:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335274:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335279:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335283:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335288:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335293:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335297:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335302:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335307:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335312:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335316:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335321:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335326:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335331:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335336:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335341:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335345:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335351:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335356:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335361:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335367:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335372:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335377:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335382:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335387:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335403:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335408:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335413:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335418:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335456:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335461:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335466:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335471:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335477:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335482:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335488:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335493:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335498:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335502:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335507:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335511:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335516:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.335520:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607876.336069:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff99a1e8efde00:5859] 1 exiting: rc = 0 00000100:00100000:1.0:1789607876.336498:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff99a1e8efd000:5858] 0 exiting: rc = 1 00000100:00100000:1.0:1789607876.336907:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336914:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336921:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336941:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336947:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336951:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336958:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336963:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336968:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336973:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336979:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336984:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336990:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.336995:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337002:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337006:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337011:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337017:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337023:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337028:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337032:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337037:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337042:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337047:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337052:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337058:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337064:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337069:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337074:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337080:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337085:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337091:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337097:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337103:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337109:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337115:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337121:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337126:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337138:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337144:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337149:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337155:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337160:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337166:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337172:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337177:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337183:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337188:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337194:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337201:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337206:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337212:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337220:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337226:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337232:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337238:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337243:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337249:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337254:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337259:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337266:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337271:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337277:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337283:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.337977:0:5862:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff99a1c8de3200:5862] 2 exiting: rc = 0 00000100:00100000:2.0:1789607876.338213:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff99a1c8de2800:5860] 0 exiting: rc = 1 00000100:00100000:2.0:1789607876.338710:0:5861:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff99a1c6492e00:5861] 1 exiting: rc = 0 00000100:00100000:1.0:1789607876.338895:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.338903:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.338910:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.338917:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.338925:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.338930:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.338938:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.338944:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.338963:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.338968:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.338974:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.338980:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.338997:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339006:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339012:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339017:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339024:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339030:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339037:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339043:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339050:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339057:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339064:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339071:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339077:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339084:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339090:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339097:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339104:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339109:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339115:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339122:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339127:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339133:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339139:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339144:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339164:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339170:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339176:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339181:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339187:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339192:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339197:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339210:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339216:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339221:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339227:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339232:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339237:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339242:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339248:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339253:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339258:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339263:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339268:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339274:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339279:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339285:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339290:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339295:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339301:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339307:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339314:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607876.339331:0:13033:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789607876.347020:0:13033:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607876.347036:0:13033:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789607876.347044:0:13033:0:(genops.c:885:class_export_put()) final put ffff99a1d362c000/MDS_uuid 00000020:00000080:1.0:1789607876.347050:0:13033:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1d362c000/MDS_uuid for MDS 00000020:01000000:1.0:1789607876.347057:0:13033:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789607876.347242:0:13033:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789607877.004213:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789607877.259897:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607877.259905:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789607877.259910:0:8:0:(import.c:65:import_set_state_nolock()) ffff99a201cc1000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607877.259921:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 405 00000100:00080000:3.0:1789607877.259928:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789607877.259942:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99a201cc1000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1789607877.259971:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2701500 x1876539541117312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607877.260006:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607877.260010:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789607877.260012:0:8:0:(import.c:65:import_set_state_nolock()) ffff99a1f500b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607877.260017:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 406 00000100:00080000:3.0:1789607877.260020:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789607877.260028:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99a1f500b800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1789607877.260042:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2701180 x1876539541117440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607877.260075:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876539541117312:0@lo:38:kworker.0 00000400:00000100:3.0:1789607877.260137:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539541117312 offset 0 length 520: 4 00000100:00100000:3.0:1789607877.260189:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876539541117440:0@lo:38:kworker.0 00000400:00000100:3.0:1789607877.260205:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876539541117440 offset 0 length 520: 4 00000100:00100000:0.0:1789607877.260284:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541117184:0@lo:400:kworker.0 00000400:00000100:0.0:1789607877.260315:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876539541117184 offset 0 length 224: 4 00010000:00010000:2.0:1789607878.028312:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607879.051757:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789607879.266631:0:13187:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789607879.286614:0:13187:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789607879.286662:0:13187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607879.286679:0:13187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607879.286687:0:13187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607879.286693:0:13187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607879.286808:0:13187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789607879.286815:0:13187:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789607879.286853:0:13187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789607879.286866:0:13187:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a0c2701500 x1876539541117312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789607892 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607879.286883:0:13187:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789607879.286891:0:13187:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789607879.286896:0:13187:0:(import.c:65:import_set_state_nolock()) ffff99a201cc1000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789607879.286902:0:13187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789607879.286905:0:13187:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a0c2701500 x1876539541117312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789607892 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607879.286911:0:13187:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789607879.286913:0:13187:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:3.0:1789607879.287035:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876539541117312:0@lo:38:kworker.0 00010000:00010000:2.0:1789607879.289675:0:13187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607879.289702:0:13187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607879.289711:0:13187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607879.289720:0:13187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.289960:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607879.289973:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.289982:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b400 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:0.0:1789607879.289987:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.289997:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607879.290006:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607879.290012:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607879.290016:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789607879.290020:0:5836:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789607879.290069:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.290085:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607879.290133:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.290140:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d103b400/0x33f091d001386041 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001386048 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.290163:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607879.290188:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.290194:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b600 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:0.0:1789607879.290198:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.290205:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607879.290211:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607879.290216:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607879.290219:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789607879.290230:0:5836:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.290237:0:5836:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607879.290243:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.290250:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607879.290252:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607879.290254:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607879.290329:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541117568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607879.290445:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607879.290519:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607879.290524:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541117696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789607879.290548:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607879.290582:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541117568 00000100:00100000:3.0:1789607879.290590:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541117568 00000100:00100000:3.0:1789607879.290629:0:8517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541117696 00000100:00100000:3.0:1789607879.290631:0:8517:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541117696 00000100:00100000:3.0:1789607879.290648:0:8517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607879.290657:0:8517:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2701500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3311:x1876539541117568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789607879.290672:0:8517:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789607879 with bad export cookie 3742651612904578346 00000100:00100000:0.0:1789607879.292017:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789607879.292030:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c9d67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1876539541117696:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789607879.292040:0:5832:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789607879 with bad export cookie 3742651612904578346 00000100:00100000:0.0:1789607879.292153:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c9d67850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1876539541117696:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (1603us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789607879.292176:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789607879.292283:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789607879.292290:0:3311:0:(import.c:65:import_set_state_nolock()) ffff99a1c6584800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789607879.292295:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1789607879.292372:0:13187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789607879.292385:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d103b600/0x33f091d00138604f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d001386056 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607879.292449:0:13187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607879.292458:0:13187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607879.292464:0:13187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607879.292471:0:13187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607879.292484:0:13187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789607879.292488:0:13187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1789607879.292493:0:13187:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789607879.292523:0:13187:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789607879.292527:0:13187:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789607879.292533:0:13187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607879.292540:0:13187:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789607879.292544:0:13187:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff99a1e4cdb380) has no exports 00000020:00080000:2.0:1789607879.292572:0:13187:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff99a1e4cdb380) has no exports 00000020:01000000:2.0:1789607879.294366:0:13187:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a1d20af600 - data ffff99a1ffdcba20/ffff99a1f5002000 00000020:01000000:2.0:1789607879.294649:0:13187:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a1e4fa1720 - data ffff99a1f19fd0d8/ffff99a1ff7d1800 00010000:00010000:0.0:1789607879.295148:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607879.295161:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.295174:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558ea00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:0.0:1789607879.295179:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.295189:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607879.295197:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607879.295202:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789607879.295205:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789607879.295208:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1789607879.306642:0:8517:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2701500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3311:x1876539541117568:12345-0@lo:103:ldlm_bl.0 Request processed in 15975us (16208us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789607879.306659:0:8517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1789607879.308500:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789607879.322717:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.103@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789607879.322722:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789607879.322733:0:3311:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a0c2702d80 x1876539541117184/t0(0) o400->MGC192.168.202.103@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789607893 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607879.322913:0:3311:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a0c2705880 x1876539541117568/t0(0) o103->MGC192.168.202.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789607895 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607879.322924:0:3311:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a0c2704000 x1876539541117696/t0(0) o103->MGC192.168.202.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789607895 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607879.322973:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d7ee8c63-baa9-4366-97c9-8054ab743e80:3310:1876539541117184:0@lo:400:kworker.0 10000000:01000000:1.0:1789607879.322994:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789607879.322998:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789607879.323000:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1789607879.324705:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.324725:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607879.324772:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607879.324781:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001386278 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x33f091d00138627f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607879.324859:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d7ee8c63-baa9-4366-97c9-8054ab743e80:0:1876539541117824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789607879.324866:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607879.324869:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607879.324884:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789607879.325672:0:3311:0:(import.c:65:import_set_state_nolock()) ffff99a1c6584800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789607879.325681:0:3311:0:(import.c:545:import_select_connection()) MGC192.168.202.103@tcp: connect to NID 0@lo last attempt 168 00000100:00080000:1.0:1789607879.325700:0:3311:0:(import.c:666:import_select_connection()) MGC192.168.202.103@tcp: import ffff99a1c6584800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1789607879.325727:0:3311:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a201878380 x1876539541117952/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607879.325778:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d7ee8c63-baa9-4366-97c9-8054ab743e80:3308:1876539541117952:0@lo:250:ptlrpcd_00_02.0 00000100:00100000:1.0:1789607879.325923:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541117568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607879.325937:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d7ee8c63-baa9-4366-97c9-8054ab743e80:3311:1876539541117696:0@lo:103:ldlm_bl.0 00000400:00000100:3.0:1789607879.325988:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876539541117952 offset 0 length 520: 4 00100000:10000000:2.0:1789607879.341512:0:13187:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789607879.368514:0:13187:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385e5e 00000020:00000080:3.0:1789607879.368530:0:13187:0:(genops.c:885:class_export_put()) final put ffff99a1fb1c3800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789607879.368551:0:13187:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a1c8d84800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789607879.368556:0:13187:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a1c8d84800 2 00000020:01000004:3.0:1789607879.368561:0:13187:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99a1c8d84800 from lustre-OST0000 00000020:00000080:3.0:1789607879.368593:0:13187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789607879.368608:0:13187:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789607879.368612:0:13187:0:(genops.c:885:class_export_put()) final put ffff99a1e8ecb000/lustre-OST0000_UUID 00000020:00000080:3.0:1789607879.368615:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1e8ecb000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789607879.368623:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789607879.368669:0:13187:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789607879.368673:0:13187:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789607879.368677:0:13187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607879.368683:0:13187:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789607879.368692:0:13187:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99a1f61b7000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789607879.368699:0:13187:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff99a1ff84b380) has exports, disconnecting them 00000020:00080000:3.0:1789607879.368703:0:13187:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99a1f61b7000), last request at 1789607652 00000020:00000080:3.0:1789607879.368707:0:13187:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385e88 00000020:00080000:3.0:1789607879.368716:0:13187:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99a1f61b7000): rc 0 00000020:00000080:3.0:1789607879.368721:0:13187:0:(genops.c:885:class_export_put()) final put ffff99a1f61b7000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789607879.369476:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1fb1c3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789607879.369492:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1f61b7000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789607879.370661:0:13187:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789607879.370668:0:13187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789607879.370672:0:13187:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789607879.370677:0:13187:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789607879.370857:0:13187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607879.370866:0:13187:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789607879.370874:0:13187:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a1c8d84800 1 00000020:00000080:0.0:1789607879.370881:0:13187:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385e18 00000020:00000080:0.0:1789607879.370890:0:13187:0:(genops.c:885:class_export_put()) final put ffff99a201cc7000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789607879.370895:0:13187:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789607879.370901:0:13187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607879.370905:0:13187:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789607879.370908:0:13187:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff99a1c658cd40) has no exports 00000020:00000080:1.0:1789607879.371513:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a201cc1000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789607879.371523:0:8:0:(genops.c:885:class_export_put()) final put ffff99a1e8eca800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789607879.371526:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1e8eca800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789607879.371537:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789607879.371596:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201cc7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789607879.394368:0:13187:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607879.394386:0:13187:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1789607879.394392:0:13187:0:(genops.c:885:class_export_put()) final put ffff99a1c8d85000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789607879.394407:0:13187:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1c8d85000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1789607879.394415:0:13187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1789607879.394571:0:13187:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99a1c8d83000 00000020:02000400:0.0:1789607879.394626:0:13187:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789607880.076086:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607881.099582:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607882.123725:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789607882.380811:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d7ee8c63-baa9-4366-97c9-8054ab743e80->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607882.380828:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d7ee8c63-baa9-4366-97c9-8054ab743e80->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607882.380832:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789607882.380862:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:1.0:1789607882.471450:0:13337:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789607882.482604:0:13337:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789607882.482725:0:13337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607882.482748:0:13337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607882.482757:0:13337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607882.482764:0:13337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607882.482788:0:13337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789607882.482795:0:13337:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789607882.482833:0:13337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789607882.484158:0:13337:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a0c2701180 x1876539541117440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789607892 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607882.484180:0:13337:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789607882.484189:0:13337:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789607882.484197:0:13337:0:(import.c:65:import_set_state_nolock()) ffff99a1f500b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789607882.484202:0:13337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789607882.484204:0:13337:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a0c2701180 x1876539541117440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789607892 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607882.484209:0:13337:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789607882.484212:0:13337:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:1.0:1789607882.484276:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876539541117440:0@lo:38:kworker.0 00010000:00010000:1.0:1789607882.484542:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607882.484553:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607882.484564:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a600 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:1.0:1789607882.484590:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607882.484602:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607882.484609:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607882.484616:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789607882.484619:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789607882.484621:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789607882.484640:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99a1c6584800 00010000:00010000:1.0:1789607882.484644:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607882.484651:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d103a600/0x33f091d001386025 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x33f091d00138602c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607882.484663:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607882.484665:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607882.484666:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607882.486061:0:13337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607882.486104:0:13337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607882.486113:0:13337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607882.486120:0:13337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607882.487651:0:13337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789607882.487682:0:13337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607882.487698:0:13337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607882.487705:0:13337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607882.487713:0:13337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607882.487891:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607882.487903:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607882.487913:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1511200 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607882.487917:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607882.487927:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607882.487936:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607882.487942:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789607882.487945:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789607882.487962:0:5836:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99a1c6584800 00010000:00010000:2.0:1789607882.487967:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607882.487974:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c1511200/0x33f091d001386033 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x33f091d00138603a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607882.488149:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607882.488156:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607882.488163:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2a00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:1.0:1789607882.488166:0:5836:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607882.488173:0:5836:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607882.488199:0:5836:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607882.488205:0:5836:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789607882.488208:0:5836:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789607882.488213:0:5836:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99a1c6584800 00010000:00010000:1.0:1789607882.488217:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607882.488224:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607882.488226:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607882.488228:0:5836:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607882.488338:0:13337:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789607882.488345:0:13337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2a00/0x33f091d00138626a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x33f091d001386271 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607882.488372:0:13337:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789607882.488379:0:13337:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1789607882.488381:0:13337:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789607882.488458:0:13337:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789607882.488464:0:13337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789607882.488472:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789607882.488480:0:13337:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789607882.488486:0:13337:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff99a1ff84cd40) has no exports 00000020:00080000:3.0:1789607882.488521:0:13337:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff99a1ff84cd40) has no exports 00010000:00010000:1.0:1789607882.490177:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789607882.491628:0:13337:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a1d20aff00 - data ffff99a1c90450d8/ffff99a1ff451000 00000020:01000000:3.0:1789607882.491826:0:13337:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a1e8ae29c0 - data ffff99a1ffd911b0/ffff99a1f5007000 00100000:10000000:1.0:1789607882.514270:0:13337:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789607882.551463:0:13337:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385f29 00000020:00000080:0.0:1789607882.551481:0:13337:0:(genops.c:885:class_export_put()) final put ffff99a1e4ce1000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789607882.551503:0:13337:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a1e8ccd800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789607882.551508:0:13337:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a1e8ccd800 2 00000020:01000004:0.0:1789607882.551511:0:13337:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99a1e8ccd800 from lustre-OST0001 00000020:00000080:0.0:1789607882.551554:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607882.551569:0:13337:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789607882.551573:0:13337:0:(genops.c:885:class_export_put()) final put ffff99a201b34800/lustre-OST0001_UUID 00000020:00000080:0.0:1789607882.551599:0:13337:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201b34800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789607882.551610:0:13337:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1789607882.551900:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1e4ce1000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1789607882.552051:0:13337:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d7ee8c63-baa9-4366-97c9-8054ab743e80->MGS 00010000:00010000:0.0:1789607882.552074:0:13337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1c1510400/0x33f091d001385e3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d001385e42 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607882.552089:0:13337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1c1510400/0x33f091d001385e3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d001385e42 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607882.552097:0:13337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789607882.552100:0:13337:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789607882.552104:0:13337:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789607882.552124:0:13337:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99a1c6584800 00010000:00010000:0.0:1789607882.552128:0:13337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1c1510400/0x33f091d001385e3b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x33f091d001385e42 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607882.552148:0:13337:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001386079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x33f091d001386080 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607882.552156:0:13337:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001386079 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x33f091d001386080 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607882.552162:0:13337:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789607882.552164:0:13337:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789607882.552166:0:13337:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789607882.552556:0:13337:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99a1c6584800 00010000:00010000:0.0:1789607882.552560:0:13337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001386079 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x33f091d001386080 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789607882.552587:0:13337:0:(import.c:65:import_set_state_nolock()) ffff99a1c6584800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789607882.552592:0:13337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789607882.552603:0:13337:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789607882.552605:0:13337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789607882.552610:0:13337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789607882.552625:0:13337:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a201878380 x1876539541117952/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789607889 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789607882.552638:0:13337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789607882.552640:0:13337:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:1.0:1789607882.552795:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d7ee8c63-baa9-4366-97c9-8054ab743e80:3308:1876539541117952:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:0.0:1789607882.552931:0:13337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789607882.552942:0:13337:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385d1c 00000020:00000080:0.0:1789607882.552951:0:13337:0:(genops.c:885:class_export_put()) final put ffff99a1d362a000/d7ee8c63-baa9-4366-97c9-8054ab743e80 00000020:01000000:0.0:1789607882.553046:0:13337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.103@tcp (flags='') 00000020:00000080:0.0:1789607882.553056:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607882.553066:0:13337:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789607882.553072:0:13337:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff99a1c6588000) has no exports 00000020:00000080:2.0:1789607882.553469:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1d362a000/d7ee8c63-baa9-4366-97c9-8054ab743e80 for MGC192.168.202.103@tcp 10000000:01000000:1.0:1789607882.553580:0:5845:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789607882.553771:0:13337:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.103@tcp: client import never connected 00000100:00080000:0.0:1789607882.553777:0:13337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789607882.553779:0:13337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789607882.553783:0:13337:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789607882.553785:0:13337:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789607882.553908:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789607882.553917:0:13337:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.103@tcp (uuid d7ee8c63-baa9-4366-97c9-8054ab743e80) 00000020:01000000:0.0:1789607882.553925:0:13337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789607882.553930:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789607882.553935:0:13337:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789607882.553941:0:13337:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99a201b34000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789607882.553948:0:13337:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff99a1f61a19c0) has exports, disconnecting them 00000020:00080000:0.0:1789607882.553953:0:13337:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99a201b34000), last request at 1789607674 00000020:00000080:0.0:1789607882.553958:0:13337:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385f53 00000020:00000080:2.0:1789607882.554046:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1c6584800 for MGC192.168.202.103@tcp 00000020:00000080:2.0:1789607882.554069:0:8:0:(genops.c:885:class_export_put()) final put ffff99a1c6581000/d7ee8c63-baa9-4366-97c9-8054ab743e80 00000020:00000080:2.0:1789607882.554072:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1c6581000/d7ee8c63-baa9-4366-97c9-8054ab743e80 for MGC192.168.202.103@tcp 00000020:01000000:2.0:1789607882.554078:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.103@tcp (d7ee8c63-baa9-4366-97c9-8054ab743e80) 00000020:00080000:0.0:1789607882.554945:0:13337:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff99a201b34000): rc 0 00000020:00000080:0.0:1789607882.554954:0:13337:0:(genops.c:885:class_export_put()) final put ffff99a201b34000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789607882.555867:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201b34000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789607882.558646:0:13337:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789607882.558672:0:13337:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789607882.558678:0:13337:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789607882.558689:0:13337:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789607882.558778:0:5836:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789607882.558958:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:2.0:1789607882.559083:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff99a1f500b800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1789607882.560644:0:5830:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99a1c8f5d600:5830] 0 exiting: rc = 1 00000100:00100000:0.0:1789607882.579689:0:5831:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99a1c8f5c400:5831] 1 exiting: rc = 0 00000100:00100000:1.0:1789607882.579899:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789607882.580499:0:5832:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99a1c8f5c600:5832] 0 exiting: rc = 1 00000100:00100000:2.0:1789607882.580599:0:8517:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99a1ff99a000:8517] 3 exiting: rc = 0 00000100:00100000:3.0:1789607882.581042:0:5834:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99a1e8ed7400:5834] 2 exiting: rc = 0 00000100:00100000:3.0:1789607882.581163:0:5833:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99a1e8ed6200:5833] 1 exiting: rc = 0 00000100:00100000:1.0:1789607882.581695:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581705:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581714:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581722:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581729:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581760:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581768:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581777:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581784:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581901:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581910:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581916:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581922:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581930:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581937:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581945:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581952:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.581959:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582032:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582039:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582046:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582052:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582058:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582064:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582071:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582078:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582084:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582091:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582097:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582102:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582108:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582114:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582121:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582128:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582135:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582141:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582148:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582154:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582161:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582166:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582244:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582251:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582257:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582264:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582270:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582276:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582283:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582289:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582295:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582301:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582383:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582391:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582398:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582405:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582411:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582417:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582458:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582464:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582470:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582477:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582484:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582490:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582496:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.582504:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789607882.585931:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789607882.585953:0:13337:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789607882.586023:0:13337:0:(genops.c:885:class_export_put()) final put ffff99a1f500a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789607882.586031:0:13337:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1f500a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789607882.586046:0:13337:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1789607882.586142:0:13337:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a1e8ccd800 1 00000020:00000080:1.0:1789607882.586154:0:13337:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x33f091d001385ef8 00000020:00000080:1.0:1789607882.586166:0:13337:0:(genops.c:885:class_export_put()) final put ffff99a1c8cff800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789607882.586249:0:13337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789607882.586257:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789607882.586283:0:13337:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789607882.586288:0:13337:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff99a1c8cf4d40) has no exports 00000020:00000080:2.0:1789607882.586566:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1c8cff800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789607882.615263:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607882.615311:0:13337:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789607882.615322:0:13337:0:(genops.c:885:class_export_put()) final put ffff99a1e8ccb800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789607882.615330:0:13337:0:(genops.c:844:class_export_destroy()) destroying export ffff99a1e8ccb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789607882.615352:0:13337:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789607882.615657:0:13337:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99a1e8ccd000 00000020:01000000:2.0:1789607882.615707:0:13337:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789607882.615714:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789607882.615720:0:13337:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789607882.615727:0:13337:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff99a1f61a4d40) has no exports 00000020:00000080:2.0:1789607882.615776:0:13337:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789607882.615794:0:13337:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789607882.615799:0:13337:0:(genops.c:885:class_export_put()) final put ffff99a201cc6800/OSS_uuid 00000020:00000080:2.0:1789607882.615801:0:13337:0:(genops.c:844:class_export_destroy()) destroying export ffff99a201cc6800/OSS_uuid for OSS 00000020:01000000:2.0:1789607882.615807:0:13337:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789607882.615922:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff99a1fb259600:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1789607882.618554:0:8471:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff99a1ee196c00:8471] 3 exiting: rc = 0 00000100:00080000:2.0:1789607882.618681:0:5843:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789607882.623167:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff99a201b6ec00:6694] 1 exiting: rc = 0 00000100:00100000:3.0:1789607882.623339:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff99a201b6f000:6695] 2 exiting: rc = 0 00000100:00100000:0.0:1789607882.624223:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624265:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624275:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624286:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624293:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624299:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624317:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624325:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624332:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624340:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624347:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624353:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624360:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624376:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624382:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624389:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624396:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624402:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624409:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624416:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624447:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624455:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624461:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624467:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624473:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624480:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624485:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624489:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624495:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624501:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624506:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624511:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624517:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624523:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624529:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624535:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624547:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624553:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624559:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624565:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624570:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624576:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624582:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624587:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624600:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624607:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624613:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624619:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624625:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624630:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624636:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624642:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624647:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624653:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624659:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624669:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624674:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624680:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624685:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624694:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624704:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624710:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624716:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.624722:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.629287:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99a1facb0800:6696] 0 exiting: rc = 1 00000100:00100000:1.0:1789607882.629707:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99a1facb0000:6697] 1 exiting: rc = 0 00000100:00100000:0.0:1789607882.631512:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631534:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631541:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631548:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631555:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631562:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631604:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631611:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631619:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631629:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631635:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631641:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631647:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631653:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631660:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631666:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631673:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631680:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631687:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631693:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631699:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631706:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631712:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631718:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631724:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631732:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631739:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631745:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631751:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631757:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631764:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631770:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631776:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.631783:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632212:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632221:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632228:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632233:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632240:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632246:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632251:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632267:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632275:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632281:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632287:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632292:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632298:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632314:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632321:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632327:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632332:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632338:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632344:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632356:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632375:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632381:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632388:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632395:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632400:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632407:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632413:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632419:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632444:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.632451:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.635520:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99a1facb0400:6698] 0 exiting: rc = 1 00000100:00100000:3.0:1789607882.642994:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99a201b6e000:6700] 2 exiting: rc = 0 00000100:00100000:2.0:1789607882.644102:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99a1facb1a00:6699] 1 exiting: rc = 0 00000100:00100000:0.0:1789607882.644631:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644644:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644653:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644661:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644685:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644694:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644702:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644709:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644717:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644725:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644732:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644739:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644768:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644779:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644857:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644868:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644875:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644881:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644888:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644895:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644901:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644923:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644931:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644940:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644948:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.644957:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645034:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645042:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645049:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645056:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645062:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645070:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645077:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645083:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645091:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645097:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645104:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645111:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645118:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645125:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645132:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645139:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645145:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645152:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645159:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645167:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645256:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645278:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645289:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645388:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645398:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645584:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645591:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645609:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645631:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645638:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645647:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645656:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645663:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645671:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645682:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645690:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645698:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789607882.645706:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696396:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99a1e8fd0e00:6702] 1 exiting: rc = 0 00000100:00100000:2.0:1789607882.696597:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99a1e8fd0800:6701] 0 exiting: rc = 1 00000100:00100000:1.0:1789607882.696865:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696873:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696879:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696885:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696902:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696907:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696914:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696919:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696925:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696932:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696938:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696943:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696950:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.696957:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697069:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697076:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697082:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697087:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697094:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697100:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697107:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697113:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697119:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697127:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697133:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697150:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697158:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697165:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697171:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697198:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697209:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697216:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697222:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697228:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697235:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697243:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697249:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697256:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697510:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697550:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697556:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697561:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697567:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697573:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697578:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697584:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697589:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697595:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697600:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697607:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697612:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697621:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697628:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697633:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697639:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697644:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697649:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697654:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697659:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697664:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697669:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697675:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697680:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.697684:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.701580:0:6704:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99a1e8fd1c00:6704] 1 exiting: rc = 0 00000100:00100000:3.0:1789607882.701640:0:6703:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99a1d109ae00:6703] 0 exiting: rc = 1 00000100:00100000:1.0:1789607882.702950:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.702977:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703151:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703174:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703185:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703194:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703206:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703213:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703220:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703226:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703233:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703255:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703263:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703270:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703277:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703284:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703292:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703298:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703306:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703314:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703320:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703327:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703334:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703357:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703375:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703382:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703391:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703397:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703403:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703409:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703417:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703451:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703460:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703472:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703496:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703519:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703528:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703534:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703541:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703548:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703560:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703571:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703578:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703584:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703589:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703595:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703600:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703621:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703633:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703641:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703649:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703654:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703660:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703665:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703671:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703677:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703683:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703690:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.703696:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.705145:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.705165:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.705172:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.705181:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789607882.705189:0:13337:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789607882.763941:0:13337:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789607900.634764:0:13952:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789607909.341067:0:14413:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789607909.341075:0:14413:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789607909.341224:0:14413:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99a0c31fe000 00000020:01000004:3.0:1789607909.341246:0:14413:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789607909.341257:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789607909.341274:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99a1ff8499c0) 00000020:00000080:3.0:1789607909.341290:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789607909.361116:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789607909.378635:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1789607909.379144:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 389: rc = 0 00100000:10000000:3.0:1789607909.379242:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 389: rc = 0 00100000:10000000:3.0:1789607909.379479:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789607909.379550:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 389: rc = 0 00100000:10000000:3.0:1789607909.379653:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 389: rc = 0 00100000:10000000:3.0:1789607909.379752:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 389: rc = 0 00100000:10000000:3.0:1789607909.379901:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 389: rc = 0 00100000:10000000:3.0:1789607909.382709:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 391: rc = 0 00100000:10000000:2.0:1789607909.390723:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 210: rc = 0 00100000:10000000:2.0:1789607909.390840:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 210: rc = 0 00100000:10000000:2.0:1789607909.399294:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 214: rc = 0 00100000:10000000:2.0:1789607909.401323:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 214: rc = 0 00100000:10000000:2.0:1789607909.402872:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 214: rc = 0 00100000:10000000:2.0:1789607909.403215:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 214: rc = 0 00100000:10000000:2.0:1789607909.404147:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 214: rc = 0 00100000:10000000:2.0:1789607909.404566:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 214: rc = 0 00100000:10000000:2.0:1789607909.404848:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 214: rc = 0 00100000:10000000:2.0:1789607909.405201:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 214: rc = 0 00100000:10000000:2.0:1789607909.405644:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 214: rc = 0 00100000:10000000:2.0:1789607909.406006:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 214: rc = 0 00100000:10000000:2.0:1789607909.406735:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 214: rc = 0 00100000:10000000:2.0:1789607909.406951:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 214: rc = 0 00100000:10000000:2.0:1789607909.407368:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 547: rc = 0 00100000:10000000:2.0:1789607909.408224:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 547: rc = 0 00100000:10000000:2.0:1789607909.408573:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 547: rc = 0 00100000:10000000:2.0:1789607909.408840:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 547: rc = 0 00100000:10000000:2.0:1789607909.409255:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 547: rc = 0 00100000:10000000:2.0:1789607909.409880:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 547: rc = 0 00100000:10000000:2.0:1789607909.410195:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 547: rc = 0 00100000:10000000:2.0:1789607909.410502:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 547: rc = 0 00100000:10000000:2.0:1789607909.410831:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 547: rc = 0 00100000:10000000:2.0:1789607909.411079:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 547: rc = 0 00100000:10000000:2.0:1789607909.411353:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 547: rc = 0 00100000:10000000:2.0:1789607909.411622:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 547: rc = 0 00100000:10000000:2.0:1789607909.411874:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 547: rc = 0 00100000:10000000:2.0:1789607909.412824:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 547: rc = 0 00100000:10000000:2.0:1789607909.413530:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 547: rc = 0 00100000:10000000:2.0:1789607909.413782:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 547: rc = 0 00100000:10000000:2.0:1789607909.414047:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 547: rc = 0 00100000:10000000:2.0:1789607909.414308:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 547: rc = 0 00100000:10000000:2.0:1789607909.414595:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 547: rc = 0 00100000:10000000:2.0:1789607909.414842:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 547: rc = 0 00100000:10000000:2.0:1789607909.415120:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 547: rc = 0 00100000:10000000:2.0:1789607909.415365:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 547: rc = 0 00100000:10000000:2.0:1789607909.415641:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 547: rc = 0 00100000:10000000:2.0:1789607909.415889:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 547: rc = 0 00100000:10000000:2.0:1789607909.418715:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 547: rc = 0 00100000:10000000:2.0:1789607909.419776:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 547: rc = 0 00100000:10000000:2.0:1789607909.420119:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 547: rc = 0 00100000:10000000:2.0:1789607909.420413:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 547: rc = 0 00100000:10000000:2.0:1789607909.420723:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 547: rc = 0 00100000:10000000:2.0:1789607909.420987:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 547: rc = 0 00100000:10000000:2.0:1789607909.421290:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 547: rc = 0 00100000:10000000:2.0:1789607909.421569:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 547: rc = 0 00100000:10000000:2.0:1789607909.421933:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 217: rc = 0 00100000:10000000:2.0:1789607909.424326:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789607909.424794:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:3.0:1789607909.429749:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789607909.429929:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:3.0:1789607909.430255:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789607909.430326:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:3.0:1789607909.431028:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789607909.431127:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 211: rc = 0 00100000:10000000:3.0:1789607909.431341:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789607909.431411:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 211: rc = 0 00100000:10000000:3.0:1789607909.431676:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789607909.431746:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 211: rc = 0 00000020:00000080:3.0:1789607909.432081:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789607909.432092:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789607909.432105:0:14413:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d00138700f 00000020:01000004:3.0:1789607909.432128:0:14413:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789607909.432134:0:14413:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789607909.432141:0:14413:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99a0c31fe000 from MGS 00000020:01000004:3.0:1789607909.432146:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789607909.432157:0:14413:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99a1ff84cd40) 00000020:00000080:3.0:1789607909.432170:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789607909.432239:0:14413:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a0c31fe000 from MGS, refs=2 00080000:01000000:3.0:1789607909.432245:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789607909.432251:0:14413:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d00138701d 00000100:00100000:3.0:1789607909.432365:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789607909.433344:0:14413:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789607909.433353:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789607909.434133:0:14413:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789607909.434142:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789607909.434939:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607909.435268:0:14413:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789607909.435277:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789607909.436738:0:14413:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789607909.436750:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789607909.437257:0:14413:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789607909.437262:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789607909.438140:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607909.438146:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607909.438147:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607909.440987:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607909.440993:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607909.440995:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607909.441472:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789607909.442643:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789607909.472629:0:14413:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789607909.472657:0:14413:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789607909.472661:0:14413:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789607909.480568:0:14422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789607909.480867:0:14413:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789607909.481013:0:14413:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789607909.481603:0:14413:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789607909.481928:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607909.482123:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789607909.482130:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789607909.483761:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789607909.483776:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789607909.485913:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789607909.485927:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789607909.487282:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789607909.487311:0:14413:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.103@tcp' 00000020:01000004:2.0:1789607909.487313:0:14413:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789607909.487347:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.103@tcp (typ=mgc) 00000020:00000080:2.0:1789607909.487363:0:14413:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.103@tcp (ffff99a1f61a4d40) 00000020:00000080:2.0:1789607909.487384:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:1.0:1789607909.487576:0:14427:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:2.0:1789607909.487750:0:14413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a1e4ce5000@MGC192.168.202.103@tcp: add connection 192.168.202.103@tcp at head 00010000:00010000:2.0:1789607909.488129:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.103@tcp-0 is initialized 00000040:01000000:2.0:1789607909.488138:0:14413:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789607909.496523:0:14428:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789607909.496618:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.103@tcp (uuid 4d421aa7-30b1-4c66-8975-0b6c2f7ce121) 00000020:00000080:3.0:1789607909.496708:0:14413:0:(genops.c:1384:class_connect()) connect: client 4d421aa7-30b1-4c66-8975-0b6c2f7ce121, cookie 0x33f091d00138702b 00000100:00080000:3.0:1789607909.496722:0:14413:0:(import.c:545:import_select_connection()) MGC192.168.202.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789607909.496736:0:14413:0:(import.c:666:import_select_connection()) MGC192.168.202.103@tcp: import ffff99a1e4ce5000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1789607909.496773:0:14413:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2702d80 x1876539541118080/t0(0) o250->MGC192.168.202.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607909.498041:0:14413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4d421aa7-30b1-4c66-8975-0b6c2f7ce121->MGS 00000100:00100000:1.0:1789607909.498160:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3308:1876539541118080:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789607909.498241:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607909.498326:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541118080 00000100:00100000:1.0:1789607909.498334:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541118080 00000100:00100000:1.0:1789607909.498369:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607909.498375:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1876539541118080:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789607909.498401:0:14424:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 4d421aa7-30b1-4c66-8975-0b6c2f7ce121@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:1.0:1789607909.498456:0:14424:0:(genops.c:1384:class_connect()) connect: client 4d421aa7-30b1-4c66-8975-0b6c2f7ce121, cookie 0x33f091d001387032 00000100:00080000:1.0:1789607909.498606:0:14424:0:(import.c:65:import_set_state_nolock()) ffff99a1d81f5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789607909.498679:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+5:3308:x1876539541118080:12345-0@lo:250:mount.lustre.0 Request processed in 302us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607909.498687:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607909.498730:0:3308:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789607909.498739:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.103@tcp: connect to target with instance 0 00000100:00080000:1.0:1789607909.498749:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789607909.498755:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789607909.498758:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1e4ce5000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789607909.498760:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789607909.498769:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789607909.498792:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3308:1876539541118080:0@lo:250:mount.lustre.0 00000020:01000004:3.0:1789607909.498902:0:14413:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789607909.498908:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789607909.498923:0:14413:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99a1ff84b380) 00000020:00000080:3.0:1789607909.498934:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789607909.510525:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607909.510731:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789607909.510738:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789607909.519102:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789607909.519127:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789607909.519689:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789607909.519695:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789607909.521117:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607909.521348:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789607909.521354:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789607909.522275:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789607909.522283:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789607909.585129:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607909.585374:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789607909.585380:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789607909.590019:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789607909.590039:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789607909.591263:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607909.591848:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789607909.591856:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789607909.592532:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789607909.592541:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789607909.593408:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607909.593954:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789607909.593961:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789607909.594939:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789607909.594947:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789607909.596222:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607909.596591:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789607909.596598:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789607909.597292:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789607909.597300:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789607909.618793:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607909.619280:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789607909.619290:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789607909.621171:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789607909.621183:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789607909.623763:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789607909.623779:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789607909.625342:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789607909.629369:0:14413:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789607909.629381:0:14413:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789607909.629608:0:14413:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789607909.629679:0:14413:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.103@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789607909.629685:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789607909.629686:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607909.629698:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607909.629700:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607909.629701:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607909.629703:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607909.629705:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607909.629709:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607909.629711:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607909.629714:0:14413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789607909.629717:0:14413:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789607909.629720:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607909.629721:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607909.629723:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607909.629724:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607909.629724:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607909.629726:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607909.629733:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607909.629734:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607909.629735:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607909.629735:0:14413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789607909.629784:0:14413:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789607909.629813:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118208:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789607909.629910:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607909.629979:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8d9d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789607909.630229:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541118208 00000100:00100000:1.0:1789607909.630240:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541118208 00000100:00100000:1.0:1789607909.630307:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607909.630320:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+5:14413:x1876539541118208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789607909.630386:0:14426:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789607909.630389:0:14426:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789607909.630392:0:14426:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789607909.631011:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789607909.631521:0:14426:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1789607909.633853:0:14448:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789607909.633865:0:14448:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789607909.633869:0:14448:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789607909.633904:0:14448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1789607909.634410:0:14426:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789607909.634464:0:14426:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789607909.651903:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+5:14413:x1876539541118208:12345-0@lo:253:mount.lustre.0 Request processed in 21575us (21983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607909.651920:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607909.652055:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118208:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789607909.652075:0:14413:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789607909.652080:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789607909.652081:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607909.652083:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607909.652085:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607909.652086:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607909.652087:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607909.652089:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607909.652090:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607909.652092:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607909.652093:0:14413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789607909.652126:0:14413:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99a0c31fe000 from lustre-MDT0000 10000000:01000000:3.0:1789607909.652163:0:14413:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789607909.652167:0:14413:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789607909.652171:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99a1f61a4d40 10000000:01000000:3.0:1789607909.652176:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789607909.652185:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99a1f61a4d40 from 1 10000000:01000000:3.0:1789607909.652188:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789607909.652243:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607909.652256:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607909.652265:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607909.652315:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789607909.652363:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607909.652407:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c56ef000 going to sleep for 11 seconds 00000100:00100000:2.0:1789607909.652573:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541118336 00000100:00100000:2.0:1789607909.652581:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541118336 00000100:00100000:2.0:1789607909.652640:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607909.652652:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+6:14413:x1876539541118336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607909.652669:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607909.652687:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ff7e3800/0x33f091d001387047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001387040 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.652726:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff7e3800/0x33f091d001387047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001387040 expref: 7 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.652739:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ff7e3800/0x33f091d001387047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001387040 expref: 7 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.652749:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3800, rc 0) 00000100:00100000:2.0:1789607909.652794:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+7:14413:x1876539541118336:12345-0@lo:101:mount.lustre.0 Request processed in 145us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607909.652800:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607909.653115:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607909.653132:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387047 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607909.653143:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001387047 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607909.653198:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2707800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607909.653237:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607909.653259:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8ffb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789607909.653362:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541118464 00000100:00100000:3.0:1789607909.653368:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541118464 00000100:00100000:3.0:1789607909.653388:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607909.653395:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+7:14413:x1876539541118464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607909.654238:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+6:14413:x1876539541118464:12345-0@lo:501:mount.lustre.0 Request processed in 837us (993us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789607909.654248:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607909.654325:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2707800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118464:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789607909.654357:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789607909.654386:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387047 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.654399:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387047 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607909.654408:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99a0c31fe000 10000000:01000000:2.0:1789607909.654415:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789607909.654450:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99a0c31fe000 10000000:01000000:2.0:1789607909.654454:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789607909.654458:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99a0c31fe000 from 1 10000000:01000000:2.0:1789607909.654461:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789607909.654499:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2400/0x33f091d00138704e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.654509:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2400/0x33f091d00138704e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.654520:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2400/0x33f091d00138704e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607909.654539:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607909.654584:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.654631:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607909.654914:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541118592 00000100:00100000:3.0:1789607909.654923:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541118592 00000100:00100000:3.0:1789607909.655151:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789607909.655160:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+6:14413:x1876539541118592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607909.655174:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607909.655194:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558f600/0x33f091d001387055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d00138704e expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607909.655218:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558f600/0x33f091d001387055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d00138704e expref: 7 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607909.655230:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558f600/0x33f091d001387055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138704e expref: 7 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607909.655241:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f600, rc 0) 00000100:00100000:3.0:1789607909.655277:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+7:14413:x1876539541118592:12345-0@lo:101:mount.lustre.0 Request processed in 119us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607909.655295:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607909.655569:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607909.655585:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2400/0x33f091d00138704e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387055 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.655595:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2400/0x33f091d00138704e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001387055 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607909.655618:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789607909.655639:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2400/0x33f091d00138704e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387055 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.655647:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2400/0x33f091d00138704e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387055 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607909.655655:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789607909.655659:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789607909.655664:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99a0c31fe000 10000000:01000000:2.0:1789607909.655668:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789607909.655671:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789607909.655674:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789607909.655817:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2000/0x33f091d00138705c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.655826:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2000/0x33f091d00138705c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.655835:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2000/0x33f091d00138705c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607909.655851:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607909.655884:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.655914:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607909.656031:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541118720 00000100:00100000:3.0:1789607909.656038:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541118720 00000100:00100000:3.0:1789607909.656143:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607909.656151:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+7:14413:x1876539541118720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607909.656159:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607909.656168:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558fa00/0x33f091d001387063 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d00138705c expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607909.656183:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558fa00/0x33f091d001387063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d00138705c expref: 8 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607909.656192:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558fa00/0x33f091d001387063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138705c expref: 8 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607909.656200:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558fa00, rc 0) 00000100:00100000:3.0:1789607909.656226:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+8:14413:x1876539541118720:12345-0@lo:101:mount.lustre.0 Request processed in 77us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607909.656232:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607909.656323:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607909.656333:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2000/0x33f091d00138705c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387063 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.656347:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2000/0x33f091d00138705c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001387063 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607909.656401:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607909.656604:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.656663:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15480 going to sleep for 11 seconds 00000100:00100000:0.0:1789607909.659036:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541118848 00000100:00100000:0.0:1789607909.659283:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541118848 00000100:00100000:0.0:1789607909.659378:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607909.659389:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+8:14413:x1876539541118848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607909.660467:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+9:14413:x1876539541118848:12345-0@lo:501:mount.lustre.0 Request processed in 1077us (3859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607909.660477:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607909.661551:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607909.661656:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607909.661763:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.661809:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15480 going to sleep for 11 seconds 00000100:00100000:3.0:1789607909.662097:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541118976 00000100:00100000:3.0:1789607909.662117:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541118976 00000100:00100000:3.0:1789607909.662188:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789607909.662198:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+9:14413:x1876539541118976:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607909.662838:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+9:14413:x1876539541118976:12345-0@lo:503:mount.lustre.0 Request processed in 638us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607909.662847:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607909.663180:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541118976:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607909.664026:0:14449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14449:1876539541119104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607909.664120:0:14449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.664163:0:14449:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607909.664341:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541119104 00000100:00100000:0.0:1789607909.664350:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541119104 00000100:00100000:0.0:1789607909.664400:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789607909.664412:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+9:14449:x1876539541119104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789607909.665026:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+9:14449:x1876539541119104:12345-0@lo:502:llog_process_th.0 Request processed in 612us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607909.665034:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607909.665667:0:14449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14449:1876539541119104:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607909.665822:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607909.665840:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607909.665843:0:14449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789607909.665850:0:14449:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789607909.665853:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607909.665871:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99a1f61a19c0) 00000020:00000080:2.0:1789607909.665902:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789607909.665908:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789607909.666028:0:14449:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789607909.666037:0:14449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d001387071 00000020:00000080:2.0:1789607909.666497:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789607909.666503:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607909.666507:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607909.666510:0:14449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789607909.666513:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607909.666518:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607909.666520:0:14449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789607909.666522:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607909.666531:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99a1f61a3380) 00000020:00000080:2.0:1789607909.666543:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789607909.666547:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789607909.666549:0:14449:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789607909.666552:0:14449:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789607909.666559:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789607909.666613:0:14449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a0c31fe000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789607909.667366:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99a1f61a0000) 00000020:00000080:2.0:1789607909.667381:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789607909.667473:0:14449:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789607909.667481:0:14449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33f091d001387086 00000020:00000080:2.0:1789607909.667594:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789607909.667601:0:14449:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789607909.667606:0:14449:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x33f091d00138708d 00080000:01000000:2.0:1789607909.667611:0:14449:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789607909.667614:0:14449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d001387094 00010000:00010000:3.0:1789607909.757133:0:14449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789607909.758128:0:14449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1789607909.758872:0:14449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789607909.761487:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99a1ff848000) 00000020:00000080:3.0:1789607909.761515:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789607909.761609:0:14449:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789607909.761620:0:14449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d0013870a2 00000020:00000080:1.0:1789607909.766566:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789607909.789059:0:14449:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x33f091d0013870a9 00000020:00000080:1.0:1789607909.789837:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789607909.789852:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607909.789860:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607909.789862:0:14449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789607909.789865:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607909.789879:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607909.789881:0:14449:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789607909.789887:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789607909.789936:0:14449:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789607909.789958:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607909.789961:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607909.789963:0:14449:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789607909.789966:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789607909.789968:0:14449:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1789607909.789970:0:14449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789607909.789971:0:14449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789607909.789973:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789607909.789976:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607909.789977:0:14449:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789607909.789980:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789607909.789985:0:14449:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789607909.789990:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607909.789991:0:14449:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789607909.789997:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789607909.790005:0:14449:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.103@tcp to nid 0x20000c0a8ca67 (192.168.202.103@tcp) 00000020:01000000:1.0:1789607909.790043:0:14449:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789607909.790046:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789607909.790066:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99a1c65899c0) 00000020:00000080:1.0:1789607909.790085:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789607909.790090:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789607909.790188:0:14449:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789607909.790195:0:14449:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789607909.790202:0:14449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d0013870b7 00010000:00080000:1.0:1789607909.790376:0:14449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a1ceb8b800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:1.0:1789607909.790987:0:14449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789607909.793035:0:14449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789607909.793102:0:14449:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789607909.801297:0:14449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607909.801401:0:14449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789607909.801972:0:14449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789607909.803078:0:14453:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789607909.803085:0:14453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789607909.804418:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789607909.804751:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789607909.804803:0:14449:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789607909.804836:0:14449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33f091d0013870be 00000100:00080000:1.0:1789607909.804851:0:14449:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789607909.804867:0:14449:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99a1ceb8b800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1789607909.804925:0:14449:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a201878380 x1876539541119232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607909.805032:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541119232:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789607909.805129:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539541119232 offset 0 length 520: 4 00000100:00080000:1.0:1789607909.805207:0:14449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789607909.805288:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607909.805292:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607909.805294:0:14449:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789607909.805297:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789607909.805300:0:14449:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789607909.805302:0:14449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789607909.805303:0:14449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789607909.805305:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789607909.805307:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607909.805308:0:14449:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789607909.805311:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789607909.805317:0:14449:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789607909.805320:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607909.805321:0:14449:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789607909.805324:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789607909.805327:0:14449:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.103@tcp to nid 0x20000c0a8ca67 (192.168.202.103@tcp) 00000020:01000000:1.0:1789607909.805349:0:14449:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789607909.805351:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789607909.805364:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99a1c658b380) 00000020:00000080:1.0:1789607909.805375:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789607909.805386:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789607909.805923:0:14449:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789607909.805932:0:14449:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789607909.805942:0:14449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x33f091d0013870cc 00010000:00080000:1.0:1789607909.805988:0:14449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a1ffa95000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:1.0:1789607909.806314:0:14449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789607909.806636:0:14449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789607909.806666:0:14449:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789607909.811544:0:14449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607909.811723:0:14449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789607909.811853:0:14449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789607909.813390:0:14455:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789607909.813397:0:14455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789607909.814331:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789607909.814344:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789607909.814377:0:14449:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789607909.814399:0:14449:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33f091d0013870d3 00000100:00080000:3.0:1789607909.814411:0:14449:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789607909.814985:0:14449:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a1ffa95000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1789607909.815048:0:14449:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2700380 x1876539541119360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789607909.815075:0:14449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789607909.815192:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541119360:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789607909.815260:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539541119360 offset 0 length 520: 4 00000020:01000000:3.0:1789607909.815445:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607909.815461:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607909.815464:0:14449:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789607909.815468:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607909.815473:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607909.815474:0:14449:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789607909.815477:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789607909.815479:0:14449:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789607909.815482:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607909.815484:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607909.815486:0:14449:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789607909.815488:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607909.815490:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607909.815492:0:14449:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789607909.815513:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789607909.815563:0:14449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2702d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14449:1876539541119488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607909.815629:0:14449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607909.815647:0:14449:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c4f0fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607909.815863:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541119488 00000100:00100000:1.0:1789607909.815873:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541119488 00000100:00100000:1.0:1789607909.815937:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607909.815948:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+9:14449:x1876539541119488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607909.816297:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+9:14449:x1876539541119488:12345-0@lo:502:llog_process_th.0 Request processed in 350us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607909.816306:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789607909.817405:0:14449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2702d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14449:1876539541119488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789607909.817495:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607909.817507:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607909.817510:0:14449:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789607909.817515:0:14449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789607909.818237:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1789607909.818276:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789607909.818311:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2000/0x33f091d00138705c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387063 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.818327:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2000/0x33f091d00138705c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387063 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607909.818346:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a0c31fe000 from 1 10000000:01000000:2.0:1789607909.818350:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789607909.818394:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.818402:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.818413:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607909.818466:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541119616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607909.818552:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.818752:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15300 going to sleep for 11 seconds 00000100:00100000:2.0:1789607909.818804:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541119616 00000100:00100000:2.0:1789607909.818814:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541119616 00000100:00100000:2.0:1789607909.818867:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607909.818877:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+9:14413:x1876539541119616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607909.818894:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607909.818910:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ff7e3400/0x33f091d0013870e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d0013870da expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.818939:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff7e3400/0x33f091d0013870e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d0013870da expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.818951:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ff7e3400/0x33f091d0013870e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013870da expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.818979:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e3400, rc 0) 00000100:00100000:2.0:1789607909.819023:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+10:14413:x1876539541119616:12345-0@lo:101:mount.lustre.0 Request processed in 147us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607909.819029:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607909.819074:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541119616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607909.819090:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013870e1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.819100:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d0013870e1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607909.820838:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541119744:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789607909.820921:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.821018:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15300 going to sleep for 11 seconds 00000100:00100000:3.0:1789607909.821264:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541119744 00000100:00100000:3.0:1789607909.821275:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541119744 00000100:00100000:3.0:1789607909.821375:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789607909.821388:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+10:14413:x1876539541119744:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789607909.821419:0:14425:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789607909.821788:0:14425:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789607909.821937:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+10:14413:x1876539541119744:12345-0@lo:256:mount.lustre.0 Request processed in 551us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607909.821947:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607909.822036:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541119744:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789607909.822923:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789607909.823038:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013870e1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.823054:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013870e1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607909.823065:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a0c31fe000 from 1 10000000:01000000:2.0:1789607909.823069:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607909.823130:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.823155:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.823166:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607909.823194:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541119872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607909.823265:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.824187:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607909.824328:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541119872 00000100:00100000:1.0:1789607909.824339:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541119872 00000100:00100000:1.0:1789607909.824403:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789607909.824416:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+10:14413:x1876539541119872:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607909.824458:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607909.824491:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ff4ee800/0x33f091d0013870ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d0013870e8 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607909.824659:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff4ee800/0x33f091d0013870ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d0013870e8 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607909.824687:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ff4ee800/0x33f091d0013870ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013870e8 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607909.824700:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee800, rc 0) 00000100:00100000:1.0:1789607909.824785:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14413:x1876539541119872:12345-0@lo:101:mount.lustre.0 Request processed in 371us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607909.824793:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789607909.825003:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541119872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607909.825027:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013870ef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.825039:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d0013870ef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607909.825130:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541120000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607909.825167:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.825200:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607909.825399:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541120000 00000100:00100000:1.0:1789607909.825405:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541120000 00000100:00100000:1.0:1789607909.825476:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789607909.825484:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14413:x1876539541120000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607909.826197:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14413:x1876539541120000:12345-0@lo:501:mount.lustre.0 Request processed in 711us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607909.826207:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607909.826311:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541120000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607909.826350:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541120128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607909.826394:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.826460:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607909.826702:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541120128 00000100:00100000:1.0:1789607909.826709:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541120128 00000100:00100000:1.0:1789607909.826738:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789607909.826745:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14413:x1876539541120128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607909.827182:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14413:x1876539541120128:12345-0@lo:503:mount.lustre.0 Request processed in 435us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607909.827191:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607909.827346:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541120128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607909.828065:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14457:1876539541120256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607909.828145:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.828185:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607909.828291:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541120256 00000100:00100000:3.0:1789607909.828298:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541120256 00000100:00100000:3.0:1789607909.828336:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789607909.828344:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14457:x1876539541120256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607909.829035:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14457:x1876539541120256:12345-0@lo:502:llog_process_th.0 Request processed in 689us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607909.829044:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789607909.829163:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14457:1876539541120256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607909.829204:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607909.829217:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607909.829220:0:14457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789607909.829229:0:14457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a0c31fe000 00000020:00000080:2.0:1789607909.829232:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607909.829243:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607909.829246:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607909.829247:0:14457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789607909.829250:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607909.829252:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607909.829253:0:14457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789607909.829256:0:14457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a0c31fe000 00000020:00000080:2.0:1789607909.829259:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607909.829337:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607909.829341:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607909.829342:0:14457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789607909.829345:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607909.829347:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607909.829348:0:14457:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789607909.829352:0:14457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99a0c31fe000 00000020:00000080:2.0:1789607909.829354:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789607909.829400:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14457:1876539541120384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607909.829491:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.829534:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8a15900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607909.830960:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541120384 00000100:00100000:3.0:1789607909.830977:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541120384 00000100:00100000:3.0:1789607909.831056:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789607909.831084:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14457:x1876539541120384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789607909.831412:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14457:x1876539541120384:12345-0@lo:502:llog_process_th.0 Request processed in 330us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607909.832833:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789607909.833096:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14457:1876539541120384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789607909.833155:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607909.833173:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607909.833176:0:14457:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789607909.833182:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789607909.834657:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789607909.834811:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789607909.834840:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013870ef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607909.834857:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013870ef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607909.834926:0:14413:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789607909.834929:0:14413:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99a0c31fe000 10000000:01000000:0.0:1789607909.834932:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99a0c31fe000 10000000:01000000:0.0:1789607909.834936:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607909.834953:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a0c31fe000 from 1 10000000:01000000:0.0:1789607909.834957:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789607909.835017:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ada00/0x33f091d0013870f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607909.835027:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ada00/0x33f091d0013870f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607909.835039:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ada00/0x33f091d0013870f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607909.835072:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541120512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607909.835175:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607909.835234:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c38e40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607909.836125:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541120512 00000100:00100000:3.0:1789607909.836137:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541120512 00000100:00100000:3.0:1789607909.836203:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789607909.836214:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14413:x1876539541120512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607909.836231:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607909.836246:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558f800/0x33f091d0013870fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d0013870f6 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607909.836271:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558f800/0x33f091d0013870fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d0013870f6 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607909.836282:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558f800/0x33f091d0013870fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013870f6 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607909.836292:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f800, rc 0) 00000100:00100000:3.0:1789607909.836346:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14413:x1876539541120512:12345-0@lo:101:mount.lustre.0 Request processed in 134us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607909.836352:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789607909.838884:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541120512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607909.838919:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ada00/0x33f091d0013870f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013870fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607909.838932:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ada00/0x33f091d0013870f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d0013870fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607909.842846:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541120640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607909.842932:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607909.842990:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c38e40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607909.845965:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541120640 00000100:00100000:3.0:1789607909.845988:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541120640 00000100:00100000:3.0:1789607909.846066:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789607909.846079:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14413:x1876539541120640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607909.846482:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14413:x1876539541120640:12345-0@lo:501:mount.lustre.0 Request processed in 407us (3549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607909.846498:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789607909.846692:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541120640:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607909.846761:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541120768:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789607909.846809:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607909.846862:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c38e40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607909.849738:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541120768 00000100:00100000:3.0:1789607909.849767:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541120768 00000100:00100000:3.0:1789607909.849850:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789607909.849862:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14413:x1876539541120768:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607909.850192:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14413:x1876539541120768:12345-0@lo:503:mount.lustre.0 Request processed in 331us (3383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607909.850202:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789607909.852336:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2706a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541120768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607909.853188:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201879f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14461:1876539541120896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607909.853292:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607909.853353:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c1ab79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607909.853416:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541120896 00000100:00100000:2.0:1789607909.853455:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541120896 00000100:00100000:2.0:1789607909.853518:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789607909.853530:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14461:x1876539541120896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607909.854048:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14461:x1876539541120896:12345-0@lo:502:llog_process_th.0 Request processed in 517us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607909.854057:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789607909.854187:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201879f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14461:1876539541120896:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789607909.854277:0:14461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789607909.854296:0:14461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99a1c6588000) 00000020:00000080:1.0:1789607909.854321:0:14461:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789607909.854410:0:14461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a0c31fe000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789607909.854415:0:14461:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a0c31fe000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789607909.854418:0:14461:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a0c31fe000 4 00010000:00080000:1.0:1789607909.854511:0:14461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a1e8cc9000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.103@tcp at head 00010000:00010000:1.0:1789607909.859880:0:14461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789607909.860157:0:14461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789607909.860201:0:14461:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789607909.860222:0:14461:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x33f091d00138710b 00000100:00080000:1.0:1789607909.860236:0:14461:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789607909.860256:0:14461:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99a1e8cc9000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:1.0:1789607909.860306:0:14461:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a201879f80 x1876539541121024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607909.860359:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876539541121024:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789607909.860494:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789607909.860571:0:14461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789607909.868042:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14461:1876539541121152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789607909.868159:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607909.868218:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c1ab7900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607909.868490:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541121152 00000100:00100000:2.0:1789607909.868502:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541121152 00000100:00100000:2.0:1789607909.868559:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789607909.868570:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14461:x1876539541121152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789607909.869467:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14461:x1876539541121152:12345-0@lo:502:llog_process_th.0 Request processed in 893us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607909.869481:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789607909.869926:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14461:1876539541121152:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789607909.869983:0:14461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:0.0:1789607909.870210:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541121024 00000100:00100000:0.0:1789607909.870222:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541121024 00000100:00100000:0.0:1789607909.870269:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789607909.870277:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876539541121024:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789607909.870359:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201878e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876539541121024:12345-0@lo:38:llog_process_th.0 Request processed in 81us (9865us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789607909.870366:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607909.870952:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789607909.870964:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1e8cc9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789607909.870970:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789607909.870974:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201879f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876539541121024:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1789607909.872508:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789607909.872559:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789607909.872594:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ada00/0x33f091d0013870f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013870fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607909.874589:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ada00/0x33f091d0013870f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013870fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789607909.877588:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789607909.877596:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607909.877597:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607909.877599:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607909.877600:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607909.877603:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607909.877605:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607909.877606:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607909.877608:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607909.877610:0:14413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607909.877615:0:14413:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789607909.877619:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607909.877620:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789607909.877621:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607909.877622:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607909.877630:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607909.877631:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607909.877631:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789607909.877632:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789607909.877633:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607909.877634:0:14413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789607909.877680:0:14413:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789607909.877706:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2702d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541121280:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789607909.877805:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607909.877872:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c4f0f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607909.879528:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541121280 00000100:00100000:2.0:1789607909.879547:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541121280 00000100:00100000:2.0:1789607909.879607:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789607909.879617:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14413:x1876539541121280:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789607909.879652:0:14424:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789607909.879666:0:14424:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789607909.962784:0:14424:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789607909.962830:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789607909.962917:0:14447:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789607909.962924:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789607909.962953:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607909.962977:0:14447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1ff7e3400/0x33f091d0013870e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013870da expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607909.962986:0:14447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607909.963034:0:14447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1ff7e3400/0x33f091d0013870e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d0013870da expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607909.963063:0:14447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1ff7e3400/0x33f091d0013870e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d0013870da expref: 12 pid: 14426 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607909.963081:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201879f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14447:1876539541121408:0@lo:104: 00000100:00100000:1.0:1789607909.963170:0:14447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607909.963251:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c1ab7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607909.963759:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541121408 00000100:00100000:0.0:1789607909.963769:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541121408 00000100:00100000:0.0:1789607909.963847:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789607909.963859:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+3:14447:x1876539541121408:12345-0@lo:104: 00010000:00010000:0.0:1789607909.963877:0:14414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013870e1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607909.963956:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789607909.963962:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+3:14447:x1876539541121408:12345-0@lo:104: Request processed in 106us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607909.963969:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789607909.964467:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607909.964479:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013870e1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.964513:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2600 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607909.964519:0:14420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d0013870e1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.964531:0:14420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d0013870e1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607909.964539:0:14420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d0013870e1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607909.964545:0:14420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789607909.964592:0:14420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013870e1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.964598:0:14420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607909.964622:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013870e1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.964630:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d0013870da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013870e1 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.964650:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607909.964652:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607909.964654:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607909.964692:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3310:1876539541121536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607909.964743:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607909.964820:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541121536 00000100:00100000:2.0:1789607909.964826:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541121536 00010000:00010000:2.0:1789607909.964850:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1ff7e3400/0x33f091d0013870e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d0013870da expref: 13 pid: 14426 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607909.964881:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607909.964887:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+13:3310:x1876539541121536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607909.964901:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607909.964907:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1ff7e3400/0x33f091d0013870e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d0013870da expref: 13 pid: 14426 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.964919:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1ff7e3400/0x33f091d0013870e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d0013870da expref: 13 pid: 14426 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.964941:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.964951:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789607909.964969:0:14416:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002046601s 00010000:00010000:2.0:1789607909.964973:0:14416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.964982:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.964991:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.964997:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.965001:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee000 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607909.965010:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.965018:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.965027:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.965039:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607909.965069:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+13:3310:x1876539541121536:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607909.965077:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607909.965130:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3310:1876539541121536:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607909.965156:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff7e3400/0x33f091d0013870e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d0013870da expref: 12 pid: 14426 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607909.965167:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201879f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14447:1876539541121408:0@lo:104: 00010000:00010000:2.0:1789607909.965187:0:14447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.965197:0:14447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.965202:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607909.965208:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff4ee000/0x33f091d001387112 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607909.978512:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14413:x1876539541121280:12345-0@lo:253:mount.lustre.0 Request processed in 98878us (100689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607909.978533:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789607909.978689:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2702d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14413:1876539541121280:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789607909.978708:0:14413:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789607909.978712:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607909.978714:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789607909.978715:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607909.978717:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607909.978718:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607909.978719:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607909.978721:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789607909.978722:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789607909.978724:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607909.978726:0:14413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789607909.978745:0:14413:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789607909.984790:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607909.984983:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607909.985300:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607909.985600:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607909.985875:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607909.986029:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607909.989771:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607909.990132:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607909.990757:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607909.991183:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789607909.991963:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789607909.992174:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789607910.033351:0:14413:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789607910.034275:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789607910.034784:0:14469:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789607910.034790:0:14469:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789607910.035150:0:14470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789607910.035281:0:14470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607910.041835:0:14470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789607910.041935:0:14470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789607910.041940:0:14470:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1789607910.043088:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789607910.043244:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789607910.044173:0:14413:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789607910.044190:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789607910.044893:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607910.046160:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789607910.047356:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789607910.047855:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789607910.055119:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789607910.069483:0:14413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789607910.175345:0:14413:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789607910.175394:0:14413:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb85e81917988 00100000:10000000:3.0:1789607910.175404:0:14413:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789607910.177508:0:14413:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789607910.177662:0:14413:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789607910.177824:0:14413:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789607910.177856:0:14413:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789607910.478701:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789607910.734703:0:14428:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789607910.734711:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a0c31fe000 from 6 10000000:01000000:2.0:1789607910.734715:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789607910.734770:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607910.734783:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607910.734795:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607910.734822:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541121664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607910.734920:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607910.735439:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541121664 00000100:00100000:3.0:1789607910.735456:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541121664 00000100:00100000:3.0:1789607910.735540:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789607910.735551:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14428:x1876539541121664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607910.735602:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607910.735625:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558fc00/0x33f091d001387120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001387119 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607910.735656:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558fc00/0x33f091d001387120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001387119 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607910.735675:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558fc00/0x33f091d001387120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001387119 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607910.735686:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558fc00, rc 0) 00000100:00100000:3.0:1789607910.735732:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14428:x1876539541121664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607910.735740:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789607910.736119:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da840 going to sleep for 11 seconds 00000100:00100000:2.0:1789607910.736146:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541121664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607910.736161:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387120 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607910.736171:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001387120 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607910.736233:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541121792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789607910.736272:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607910.736293:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da840 going to sleep for 11 seconds 00000100:00100000:3.0:1789607910.738287:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541121792 00000100:00100000:3.0:1789607910.738306:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541121792 00000100:00100000:3.0:1789607910.738403:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789607910.738415:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14428:x1876539541121792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789607910.738482:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789607910.738526:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789607910.738530:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789607910.738911:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14428:x1876539541121792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 497us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607910.738921:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789607910.748786:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541121792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789607910.748870:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789607910.748883:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387120 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607910.748896:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387120 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607910.926866:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789607911.500620:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789607911.949524:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789607912.523870:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607913.551847:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607914.572620:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789607915.147794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607915.147803:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607915.147806:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607915.147809:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607915.147812:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789607915.147816:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789607915.147820:0:8:0:(import.c:65:import_set_state_nolock()) ffff99a1e8cc9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607915.147838:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99a1e8cc9000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1789607915.147864:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2706d80 x1876539541122048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789607915.148712:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3311:1876539541121920:0@lo:400:kworker.0 00000100:00100000:1.0:1789607915.148827:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607915.148934:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876539541122048:0@lo:38:kworker.0 00000100:00100000:1.0:1789607915.148978:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607915.149028:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541121920 00000100:00100000:1.0:1789607915.149035:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541121920 00000100:00100000:1.0:1789607915.149107:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789607915.149121:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:3311:x1876539541121920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607915.149188:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:3311:x1876539541121920:12345-0@lo:400:kworker.0 Request processed in 69us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607915.149195:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789607915.149265:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3311:1876539541121920:0@lo:400:kworker.0 00000100:00100000:0.0:1789607915.149366:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541122048 00000100:00100000:0.0:1789607915.149372:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541122048 00000100:00100000:0.0:1789607915.149416:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607915.149454:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1876539541122048:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789607915.149496:0:14433:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:0.0:1789607915.149547:0:14433:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x33f091d001387127 00000004:00100000:0.0:1789607915.149573:0:14433:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789607915.149752:0:14433:0:(import.c:65:import_set_state_nolock()) ffff99a1d06a2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607915.149809:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201879f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876539541122048:12345-0@lo:38:kworker.0 Request processed in 384us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607915.149815:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789607915.150113:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a0c2706d80 x1876539541122048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789607915.150131:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789607915.150141:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789607915.150146:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789607915.150148:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1e8cc9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789607915.150155:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876539541122048:0@lo:38:kworker.0 00000001:02000400:2.0:1789607915.256297:0:14714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789607915.596601:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607916.621304:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607917.645602:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789607917.761327:0:14864:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd073a8b50 20000000:00000080:1.0:1789607917.761346:0:14864:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a1fbc97400 uarg=0000000000000000 20000000:01000000:1.0:1789607917.761388:0:14864:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789607917.761396:0:14864:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789607917.761400:0:14864:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789607917.762386:0:14865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789607917.762501:0:14864:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789607917.766832:0:14864:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789607917.766879:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.766903:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1ff4ee800/0x33f091d0013870ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013870e8 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.766912:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.766953:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1ff4ee800/0x33f091d0013870ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d0013870e8 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.766968:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1ff4ee800/0x33f091d0013870ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d0013870e8 expref: 11 pid: 14424 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607917.766983:0:14864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201879c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14864:1876539541122176:0@lo:104: 00000100:00100000:1.0:1789607917.767059:0:14864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607917.767148:0:14864:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c1ab7840 going to sleep for 11 seconds 00000100:00100000:0.0:1789607917.767190:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541122176 00000100:00100000:0.0:1789607917.767199:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541122176 00000100:00100000:0.0:1789607917.767265:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607917.767272:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+3:14864:x1876539541122176:12345-0@lo:104: 00010000:00010000:0.0:1789607917.767288:0:14414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013870ef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607917.767340:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789607917.767346:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+3:14864:x1876539541122176:12345-0@lo:104: Request processed in 74us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607917.767353:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789607917.767367:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607917.767383:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013870ef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607917.767392:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3a00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607917.767396:0:14419:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d0013870ef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607917.767405:0:14419:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d0013870ef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607917.767413:0:14419:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d0013870ef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607917.767418:0:14419:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1789607917.767445:0:14864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201879c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14864:1876539541122176:0@lo:104: 00010000:00010000:2.0:1789607917.767463:0:14419:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013870ef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607917.767470:0:14864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607917.767470:0:14419:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607917.767492:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013870ef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607917.767510:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3a00/0x33f091d0013870e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013870ef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607917.767527:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607917.767529:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607917.767530:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607917.767550:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3312:1876539541122304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607917.767580:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607917.768022:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541122304 00000100:00100000:1.0:1789607917.768052:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541122304 00010000:00010000:1.0:1789607917.768078:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1ff4ee800/0x33f091d0013870ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d0013870e8 expref: 12 pid: 14424 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607917.768109:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607917.768117:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:3312:x1876539541122304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607917.768133:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607917.768139:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1ff4ee800/0x33f091d0013870ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d0013870e8 expref: 12 pid: 14424 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.768150:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1ff4ee800/0x33f091d0013870ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d0013870e8 expref: 12 pid: 14424 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.768178:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff4ee800/0x33f091d0013870ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d0013870e8 expref: 12 pid: 14424 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.768193:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.768202:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.768215:0:14416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.768221:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.768227:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.768233:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.768238:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef000 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607917.768243:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.768250:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.768262:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607917.768284:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607917.768322:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:3312:x1876539541122304:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607917.768329:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789607917.768400:0:14864:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607917.768410:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607917.768418:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff4ef000/0x33f091d00138712e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607917.768851:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3312:1876539541122304:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607918.668650:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789607919.051569:0:14428:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607919.051580:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a0c31fe000 from 10 10000000:01000000:2.0:1789607919.051586:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607919.051637:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607919.051649:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607919.051662:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607919.051700:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541122432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607919.051802:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607919.051883:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607919.052007:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541122432 00000100:00100000:3.0:1789607919.052027:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541122432 00000100:00100000:3.0:1789607919.052106:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789607919.052117:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+11:14428:x1876539541122432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607919.052139:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607919.052157:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558e200/0x33f091d00138713c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001387135 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607919.052184:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558e200/0x33f091d00138713c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001387135 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607919.052198:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558e200/0x33f091d00138713c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001387135 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607919.052206:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e200, rc 0) 00000100:00100000:3.0:1789607919.052256:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14428:x1876539541122432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607919.052263:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789607919.052499:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541122432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607919.052516:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138713c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607919.052545:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138713c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607919.052611:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541122560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607919.052639:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607919.052668:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da000 going to sleep for 11 seconds 00000100:00100000:3.0:1789607919.052805:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541122560 00000100:00100000:3.0:1789607919.052820:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541122560 00000100:00100000:3.0:1789607919.052853:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789607919.052860:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14428:x1876539541122560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607919.053894:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14428:x1876539541122560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1028us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607919.053905:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607919.055950:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541122560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607919.056034:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541122688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607919.056127:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607919.056180:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da000 going to sleep for 11 seconds 00000100:00100000:1.0:1789607919.056325:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541122688 00000100:00100000:1.0:1789607919.056334:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541122688 00000100:00100000:1.0:1789607919.056393:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789607919.056401:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14428:x1876539541122688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789607919.056676:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:14428:x1876539541122688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 274us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607919.056685:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789607919.057299:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541122688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789607919.058389:0:14925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789607919.058681:0:14428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789607919.058705:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607919.058715:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138713c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607919.058728:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138713c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607919.248589:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607909/real 1789607909] req@ffff99a0c2700380 x1876539541119360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607919 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607919.248626:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99a0c2700380 x1876539541119360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607919 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607919.248636:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607909/real 1789607909] req@ffff99a201878380 x1876539541119232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607919 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607919.248647:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99a201878380 x1876539541119232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607919 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789607919.248675:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1ffa95000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607919.249100:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789607919.249117:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541119360:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789607919.249125:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1ceb8b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607919.257383:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607919.257392:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789607919.257397:0:8:0:(import.c:65:import_set_state_nolock()) ffff99a1ceb8b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607919.257408:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:0.0:1789607919.257417:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607919.257450:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99a1ceb8b800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1789607919.257478:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2705180 x1876539541122944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607919.257492:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607919.257495:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789607919.257496:0:8:0:(import.c:65:import_set_state_nolock()) ffff99a1ffa95000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607919.257499:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:0.0:1789607919.257502:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789607919.257506:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a1ffa95000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1789607919.257515:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2704380 x1876539541123072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607919.257567:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3309:1876539541122816:0@lo:400:kworker.0 00000100:00100000:0.0:1789607919.257647:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607919.257727:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607919.257733:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541123200:0@lo:400:kworker.0 00000100:00100000:0.0:1789607919.257764:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607919.257800:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541122816 00000100:00100000:0.0:1789607919.257808:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541122816 00000100:00100000:0.0:1789607919.257855:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789607919.257864:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:3309:x1876539541122816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607919.257914:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:3309:x1876539541122816:12345-0@lo:400:kworker.0 Request processed in 51us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607919.257921:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789607919.258074:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541123200 00000100:00100000:0.0:1789607919.258079:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541123200 00000100:00100000:0.0:1789607919.258107:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789607919.258112:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541123200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607919.258144:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541123200:12345-0@lo:400:kworker.0 Request processed in 32us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607919.258149:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789607919.258187:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a0c2707480 x1876539541123200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607919.258201:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541123200:0@lo:400:kworker.0 00000100:00100000:0.0:1789607919.258208:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3309:1876539541122816:0@lo:400:kworker.0 00000100:00080000:3.0:1789607919.260462:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789607919.260479:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201878380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541119232:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789607919.260525:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541122944:0@lo:8:kworker.0 00000400:00000100:3.0:1789607919.260596:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539541122944 offset 0 length 520: 4 00000100:00100000:3.0:1789607919.260642:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541123072:0@lo:8:kworker.0 00000400:00000100:3.0:1789607919.260678:0:3308:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876539541123072 offset 0 length 520: 4 00010000:00010000:2.0:1789607919.692503:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607920.716791:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789607921.168319:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789607921.741889:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607922.766613:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789607923.626676:0:15113:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789607923.626681:0:15113:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789607923.626794:0:15113:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99a1d0ab7800 00000020:01000004:2.0:1789607923.626811:0:15113:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789607923.626823:0:15113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789607923.626854:0:15113:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99a1e4c83380) 00000020:00000080:2.0:1789607923.626874:0:15113:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789607923.688671:0:15113:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789607923.691035:0:15113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789607923.698111:0:15113:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1789607923.700576:0:15113:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1789607923.703564:0:15113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789607923.706243:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1789607923.708326:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1789607923.709632:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1789607923.712829:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 590: rc = 0 00100000:10000000:2.0:1789607923.721084:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 590: rc = 0 00100000:10000000:2.0:1789607923.721823:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 590: rc = 0 00100000:10000000:2.0:1789607923.722269:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 590: rc = 0 00100000:10000000:2.0:1789607923.723602:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 590: rc = 0 00100000:10000000:2.0:1789607923.724886:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 590: rc = 0 00000020:00000080:3.0:1789607923.736513:0:15113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789607923.736528:0:15113:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789607923.736541:0:15113:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x33f091d00138714a 00000020:01000004:3.0:1789607923.736551:0:15113:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789607923.736574:0:15113:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789607923.736577:0:15113:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789607923.736584:0:15113:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789607923.736589:0:15113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789607923.736614:0:15113:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99a1fbe319c0) 00000020:00000080:3.0:1789607923.736627:0:15113:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789607923.742809:0:15113:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607923.743033:0:15113:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789607923.743040:0:15113:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789607923.743339:0:15113:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789607923.743345:0:15113:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789607923.743505:0:15113:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789607923.743510:0:15113:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789607923.774957:0:15113:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789607923.775182:0:15113:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789607923.775189:0:15113:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00010000:00010000:0.0:1789607923.787956:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607923.793827:0:15113:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789607923.793846:0:15113:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789607923.853175:0:15113:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789607923.853508:0:15113:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789607923.853516:0:15113:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789607923.874386:0:15113:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789607923.874459:0:15113:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789607923.875416:0:15113:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789607923.875454:0:15113:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789607923.891689:0:15113:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789607923.891910:0:15113:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789607923.891922:0:15113:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789607923.912154:0:15113:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789607923.912170:0:15113:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789607924.015034:0:15113:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789607924.015234:0:15113:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789607924.015240:0:15113:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789607924.016926:0:15113:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789607924.016937:0:15113:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789607924.019962:0:15113:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789607924.019999:0:15113:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789607924.020006:0:15113:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789607924.046681:0:15113:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789607924.046721:0:15113:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.103@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789607924.046725:0:15113:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789607924.046727:0:15113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789607924.046728:0:15113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607924.046730:0:15113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607924.046731:0:15113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607924.046732:0:15113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607924.046734:0:15113:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607924.046735:0:15113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607924.046737:0:15113:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789607924.046740:0:15113:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789607924.046742:0:15113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789607924.046744:0:15113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789607924.046745:0:15113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607924.046746:0:15113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607924.046747:0:15113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607924.046749:0:15113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607924.046750:0:15113:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607924.046751:0:15113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607924.046751:0:15113:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789607924.046790:0:15113:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789607924.046811:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541123328:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789607924.046884:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607924.046949:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f9133a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789607924.048545:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541123328 00000100:00100000:3.0:1789607924.048557:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541123328 00000100:00100000:3.0:1789607924.048623:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789607924.048632:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:15113:x1876539541123328:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789607924.048679:0:14426:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789607924.048683:0:14426:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789607924.048687:0:14426:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789607924.088693:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:15113:x1876539541123328:12345-0@lo:253:mount.lustre.0 Request processed in 40051us (41798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607924.088710:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789607924.088810:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541123328:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789607924.088827:0:15113:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789607924.088831:0:15113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789607924.088832:0:15113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789607924.088834:0:15113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789607924.088836:0:15113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789607924.088837:0:15113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789607924.088838:0:15113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789607924.088854:0:15113:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789607924.088855:0:15113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789607924.088857:0:15113:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789607924.089026:0:15113:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99a1d0ab7800 from lustre-OST0000 10000000:01000000:3.0:1789607924.089057:0:15113:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789607924.089060:0:15113:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789607924.089067:0:15113:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99a1f61a4d40 local copy 00010000:00010000:3.0:1789607924.089078:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387047 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607924.089405:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541123456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607924.089527:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607924.089604:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789607924.089650:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541123456 00000100:00100000:0.0:1789607924.089659:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541123456 00000100:00100000:0.0:1789607924.089741:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789607924.089751:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:15113:x1876539541123456:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607924.089922:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:15113:x1876539541123456:12345-0@lo:501:mount.lustre.0 Request processed in 172us (394us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789607924.089930:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789607924.090010:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541123456:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789607924.090031:0:15113:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789607924.090648:0:15113:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789607924.090657:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387047 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607924.090667:0:15113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387047 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607924.090693:0:15113:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99a1d0ab7800 10000000:01000000:2.0:1789607924.090698:0:15113:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789607924.090703:0:15113:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99a1f61a4d40 10000000:01000000:2.0:1789607924.090706:0:15113:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789607924.090709:0:15113:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99a1f61a4d40 from 1 10000000:01000000:2.0:1789607924.090712:0:15113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789607924.090741:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3400/0x33f091d001387158 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607924.090750:0:15113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3400/0x33f091d001387158 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607924.090760:0:15113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3400/0x33f091d001387158 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607924.090778:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541123584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607924.090816:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607924.091093:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c95a09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607924.091201:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541123584 00000100:00100000:3.0:1789607924.091208:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541123584 00000100:00100000:3.0:1789607924.091322:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607924.091334:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+12:15113:x1876539541123584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607924.091353:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607924.091367:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558e600/0x33f091d00138715f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001387158 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.091394:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558e600/0x33f091d00138715f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001387158 expref: 13 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.091406:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558e600/0x33f091d00138715f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001387158 expref: 13 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.091416:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e600, rc 0) 00000100:00100000:3.0:1789607924.091577:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+13:15113:x1876539541123584:12345-0@lo:101:mount.lustre.0 Request processed in 245us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607924.091584:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789607924.091770:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541123584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607924.091787:0:15113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3400/0x33f091d001387158 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138715f expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607924.091796:0:15113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3400/0x33f091d001387158 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138715f expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607924.091813:0:15113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789607924.091868:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3400/0x33f091d001387158 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138715f expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607924.091876:0:15113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3400/0x33f091d001387158 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138715f expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607924.091883:0:15113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789607924.092004:0:15113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789607924.092012:0:15113:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789607924.092014:0:15113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789607924.092039:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001387166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.092048:0:15113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001387166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.092056:0:15113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001387166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607924.092071:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541123712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789607924.092104:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607924.092175:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c086c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607924.092225:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541123712 00000100:00100000:0.0:1789607924.092230:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541123712 00000100:00100000:0.0:1789607924.092560:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789607924.092570:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+13:15113:x1876539541123712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607924.092578:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607924.092591:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ee2ace00/0x33f091d00138716d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001387166 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607924.092609:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ee2ace00/0x33f091d00138716d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001387166 expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607924.092617:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ee2ace00/0x33f091d00138716d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001387166 expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607924.092636:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ace00, rc 0) 00000100:00100000:0.0:1789607924.092824:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+14:15113:x1876539541123712:12345-0@lo:101:mount.lustre.0 Request processed in 256us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607924.092831:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789607924.093001:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541123712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607924.093016:0:15113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001387166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138716d expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.093024:0:15113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001387166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138716d expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607924.093843:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789607924.100461:0:15113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607924.100760:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789607924.100808:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789607924.100843:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789607924.100894:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789607924.101150:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789607924.101188:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789607924.101718:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789607924.101731:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789607924.101864:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541123840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607924.102174:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607924.102508:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08540 going to sleep for 11 seconds 00000100:00100000:0.0:1789607924.104191:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541123840 00000100:00100000:0.0:1789607924.104211:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541123840 00000100:00100000:0.0:1789607924.108751:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789607924.108778:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+14:15113:x1876539541123840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607924.110104:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+14:15113:x1876539541123840:12345-0@lo:501:mount.lustre.0 Request processed in 1331us (7925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607924.110116:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789607924.111591:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541123840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607924.111657:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541123968:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607924.111728:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607924.116562:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08540 going to sleep for 11 seconds 00000100:00100000:1.0:1789607924.116671:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541123968 00000100:00100000:1.0:1789607924.116682:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541123968 00000100:00100000:1.0:1789607924.116747:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789607924.116761:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+14:15113:x1876539541123968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607924.118358:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+14:15113:x1876539541123968:12345-0@lo:503:mount.lustre.0 Request processed in 1592us (6620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607924.118389:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789607924.122654:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541123968:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789607924.124619:0:15113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789607924.124722:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607924.124816:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607924.124867:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c95a09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607924.126387:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541124096 00000100:00100000:1.0:1789607924.126400:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541124096 00000100:00100000:1.0:1789607924.126508:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789607924.126518:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+14:15113:x1876539541124096:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607924.126882:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+14:15113:x1876539541124096:12345-0@lo:502:mount.lustre.0 Request processed in 361us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607924.126894:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789607924.128310:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607924.128696:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789607924.128777:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789607924.128844:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789607924.129126:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789607924.129217:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789607924.129382:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789607924.129470:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789607924.129507:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789607924.129540:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789607924.129591:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789607924.129628:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789607924.129697:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789607924.129755:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607924.129845:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607924.130349:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789607924.133174:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541124224 00000100:00100000:2.0:1789607924.133194:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541124224 00000100:00100000:2.0:1789607924.133532:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789607924.133545:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+14:15113:x1876539541124224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607924.133854:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+14:15113:x1876539541124224:12345-0@lo:502:mount.lustre.0 Request processed in 312us (4007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607924.133862:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789607924.137277:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607924.137479:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789607924.137495:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789607924.138629:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789607924.138638:0:15127:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789607924.138645:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607924.138647:0:15127:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789607924.138653:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789607924.138668:0:15127:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99a1fbe33380) 00000020:00000080:3.0:1789607924.138689:0:15127:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789607924.138695:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789607924.138776:0:15127:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a1d0ab7800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789607924.138784:0:15127:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789607924.138792:0:15127:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x33f091d00138717b 00010000:00010000:2.0:1789607924.152058:0:15127:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789607924.153626:0:15127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789607924.165230:0:15127:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789607924.171063:0:15127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789607924.171081:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607924.171090:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607924.171092:0:15127:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789607924.171100:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789607924.171103:0:15127:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1789607924.171105:0:15127:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607924.171107:0:15127:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789607924.171109:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789607924.171111:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607924.171113:0:15127:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789607924.171115:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607924.171118:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607924.171120:0:15127:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789607924.171123:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789607924.171125:0:15127:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789607924.171127:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607924.171130:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607924.171131:0:15127:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789607924.171134:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607924.171135:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607924.171137:0:15127:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789607924.171140:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789607924.171211:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607924.171215:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607924.171217:0:15127:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789607924.171221:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1789607924.171583:0:15113:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1789607924.171609:0:15113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789607924.171635:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001387166 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138716d expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.171657:0:15113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1f558ea00/0x33f091d001387166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138716d expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607924.171667:0:15113:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1d0ab7800 from 1 10000000:01000000:3.0:1789607924.171669:0:15113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607924.171710:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.171718:0:15113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.171730:0:15113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607924.171758:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789607924.171830:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607924.171868:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08540 going to sleep for 11 seconds 00000100:00100000:1.0:1789607924.177156:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541124352 00000100:00100000:1.0:1789607924.177179:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541124352 00000100:00100000:1.0:1789607924.177264:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789607924.177276:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+14:15113:x1876539541124352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607924.177296:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607924.177316:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ff4eee00/0x33f091d001387189 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001387182 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.177347:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff4eee00/0x33f091d001387189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001387182 expref: 15 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.177359:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ff4eee00/0x33f091d001387189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001387182 expref: 15 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.177369:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4eee00, rc 0) 00000100:00100000:1.0:1789607924.177502:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+15:15113:x1876539541124352:12345-0@lo:101:mount.lustre.0 Request processed in 229us (5671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607924.177508:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789607924.178040:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607924.178060:0:15113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387189 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.178071:0:15113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001387189 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607924.178791:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789607924.180564:0:15113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789607924.191197:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789607924.193234:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789607924.193408:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789607924.193418:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789607924.193550:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607924.193618:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607924.193681:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da300 going to sleep for 11 seconds 00000100:00100000:3.0:1789607924.193833:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541124480 00000100:00100000:3.0:1789607924.193841:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541124480 00000100:00100000:3.0:1789607924.193900:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789607924.193922:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+15:15113:x1876539541124480:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607924.194167:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+15:15113:x1876539541124480:12345-0@lo:501:mount.lustre.0 Request processed in 258us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607924.194176:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789607924.195082:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789607924.195131:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607924.195193:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607924.195221:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607924.195380:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541124608 00000100:00100000:1.0:1789607924.195396:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541124608 00000100:00100000:1.0:1789607924.195449:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789607924.195457:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+15:15113:x1876539541124608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607924.195634:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+15:15113:x1876539541124608:12345-0@lo:503:mount.lustre.0 Request processed in 178us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607924.195642:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789607924.199413:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124608:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789607924.201846:0:15113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789607924.203199:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607924.204093:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607924.204192:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d20da300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607924.211120:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541124736 00000100:00100000:1.0:1789607924.211136:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541124736 00000100:00100000:1.0:1789607924.211235:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789607924.212504:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+15:15113:x1876539541124736:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607924.212842:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+15:15113:x1876539541124736:12345-0@lo:502:mount.lustre.0 Request processed in 355us (8750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607924.212852:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789607924.213466:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789607924.213781:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789607924.213842:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789607924.213894:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789607924.213949:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789607924.213997:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789607924.214070:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789607924.214111:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789607924.214146:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789607924.214186:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607924.218490:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607924.222630:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d840acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607924.222739:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541124864 00000100:00100000:3.0:1789607924.222750:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541124864 00000100:00100000:3.0:1789607924.222804:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789607924.222814:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+15:15113:x1876539541124864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607924.223128:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+15:15113:x1876539541124864:12345-0@lo:502:mount.lustre.0 Request processed in 315us (8886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607924.223137:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789607924.228126:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789607924.228352:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789607924.228368:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789607924.229496:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607924.229512:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607924.229515:0:15131:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789607924.229523:0:15131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a1d0ab7800 00000020:00000080:2.0:1789607924.229525:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607924.229532:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789607924.229535:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607924.229536:0:15131:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789607924.229539:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789607924.229541:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607924.229542:0:15131:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789607924.229546:0:15131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a1d0ab7800 00000020:00000080:2.0:1789607924.229547:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789607924.229599:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607924.232211:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607924.232219:0:15131:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789607924.232233:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607924.232251:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607924.232252:0:15131:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789607924.232257:0:15131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99a1d0ab7800 00000020:00000080:3.0:1789607924.232260:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607924.232374:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607924.232378:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607924.232379:0:15131:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789607924.232383:0:15131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789607924.235369:0:15113:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789607924.235420:0:15113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789607924.235452:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387189 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.235467:0:15113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387189 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789607924.235538:0:15113:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789607924.235541:0:15113:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99a1d0ab7800 10000000:01000000:3.0:1789607924.235545:0:15113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99a1d0ab7800 10000000:01000000:3.0:1789607924.235549:0:15113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789607924.235558:0:15113:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a1d0ab7800 from 1 10000000:01000000:3.0:1789607924.235561:0:15113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789607924.235596:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558fe00/0x33f091d001387190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.235604:0:15113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1f558fe00/0x33f091d001387190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.235615:0:15113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1f558fe00/0x33f091d001387190 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607924.235638:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789607924.235701:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607924.235738:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607924.235760:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541124992 00000100:00100000:3.0:1789607924.235767:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541124992 00000100:00100000:3.0:1789607924.235811:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607924.235820:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+15:15113:x1876539541124992:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607924.235833:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607924.235845:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558f200/0x33f091d001387197 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001387190 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.235870:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558f200/0x33f091d001387197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001387190 expref: 16 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.235895:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558f200/0x33f091d001387197 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001387190 expref: 16 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.235905:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f200, rc 0) 00000100:00100000:3.0:1789607924.235957:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15113:x1876539541124992:12345-0@lo:101:mount.lustre.0 Request processed in 138us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607924.235964:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789607924.236012:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541124992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607924.236026:0:15113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1f558fe00/0x33f091d001387190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387197 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607924.236035:0:15113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1f558fe00/0x33f091d001387190 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001387197 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607924.236597:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789607924.236905:0:15113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607924.237152:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789607924.237191:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789607924.237218:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789607924.237256:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789607924.237285:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789607924.237337:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789607924.237366:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789607924.237391:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789607924.237466:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789607924.237503:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789607924.237537:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789607924.237583:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789607924.237631:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789607924.237664:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789607924.237715:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789607924.237747:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789607924.237780:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789607924.237830:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789607924.237868:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789607924.237904:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789607924.237948:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789607924.238005:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789607924.238034:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789607924.238073:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789607924.238102:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789607924.238128:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789607924.238164:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789607924.238192:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789607924.238251:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789607924.238258:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789607924.238336:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541125120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607924.238392:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607924.238407:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2c08c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607924.238536:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541125120 00000100:00100000:3.0:1789607924.238544:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541125120 00000100:00100000:3.0:1789607924.238577:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607924.238585:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15113:x1876539541125120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607924.238786:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15113:x1876539541125120:12345-0@lo:501:mount.lustre.0 Request processed in 201us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607924.238793:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789607924.238838:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541125120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607924.238876:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541125248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607924.238907:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607924.238920:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d840ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789607924.238931:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541125248 00000100:00100000:3.0:1789607924.238935:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541125248 00000100:00100000:3.0:1789607924.238949:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789607924.238954:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15113:x1876539541125248:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607924.252417:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15113:x1876539541125248:12345-0@lo:503:mount.lustre.0 Request processed in 13442us (13489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607924.252480:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789607924.252553:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541125248:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789607924.253498:0:15113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607924.253590:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541125376:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607924.253673:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607924.263234:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d840ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789607924.271308:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541125376 00000100:00100000:2.0:1789607924.271326:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541125376 00000100:00100000:2.0:1789607924.271414:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789607924.271467:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15113:x1876539541125376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607924.271906:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15113:x1876539541125376:12345-0@lo:502:mount.lustre.0 Request processed in 443us (18233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607924.271944:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789607924.273255:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541125376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789607924.273632:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789607924.273749:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789607924.273837:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789607924.276699:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789607924.276872:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789607924.280160:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789607924.280237:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789607924.280271:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789607924.280316:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789607924.280351:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789607924.280382:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789607924.280471:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789607924.280507:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789607924.280538:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789607924.280582:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789607924.280616:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789607924.280648:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789607924.280716:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789607924.280755:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789607924.280787:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789607924.280830:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789607924.280864:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789607924.280895:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789607924.281209:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789607924.281252:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789607924.281284:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789607924.281330:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789607924.281388:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789607924.281455:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789607924.281506:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789607924.281541:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789607924.281576:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789607924.281610:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789607924.281698:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789607924.281774:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789607924.281866:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789607924.281983:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789607924.282059:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789607924.282168:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789607924.282240:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789607924.282295:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541125504:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607924.282381:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607924.297325:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d840acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607924.297405:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541125504 00000100:00100000:3.0:1789607924.297417:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541125504 00000100:00100000:3.0:1789607924.297514:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607924.297524:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15113:x1876539541125504:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607924.299511:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15113:x1876539541125504:12345-0@lo:502:mount.lustre.0 Request processed in 1975us (17117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607924.299537:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789607924.299685:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541125504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607924.300261:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789607924.300280:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789607924.304480:0:15136:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789607924.304500:0:15136:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99a1fbe30000) 00000020:00000080:3.0:1789607924.304524:0:15136:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789607924.304641:0:15136:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a1d0ab7800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789607924.304646:0:15136:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a1d0ab7800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789607924.304649:0:15136:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a1d0ab7800 3 00010000:00080000:3.0:1789607924.304705:0:15136:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a1ee445800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.103@tcp at head 00010000:00010000:0.0:1789607924.321773:0:15136:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789607924.324187:0:15136:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789607924.324234:0:15136:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789607924.324249:0:15136:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x33f091d0013871a5 00000100:00080000:0.0:1789607924.324260:0:15136:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789607924.324273:0:15136:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99a1ee445800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1789607924.324317:0:15136:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2705500 x1876539541125632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607924.324351:0:15136:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789607924.326854:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876539541125632:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789607924.326940:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789607924.327019:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607924.327024:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789607924.327027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607924.327029:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789607924.327093:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541125632 00000100:00100000:3.0:1789607924.327101:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541125632 00000100:00100000:3.0:1789607924.327137:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607924.327144:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876539541125632:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789607924.327173:0:14430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:3.0:1789607924.327220:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x33f091d0013871ac 00000004:00100000:3.0:1789607924.327235:0:14430:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789607924.327272:0:14430:0:(import.c:65:import_set_state_nolock()) ffff99a1c8e60000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607924.327335:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876539541125632:12345-0@lo:38:llog_process_th.0 Request processed in 190us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607924.327342:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607924.327371:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541125760:0@lo:400:kworker.0 00000100:00100000:3.0:1789607924.327400:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607924.327464:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541125760 00000100:00100000:3.0:1789607924.327468:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541125760 00000100:00100000:3.0:1789607924.327497:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789607924.327503:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541125760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607924.327539:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541125760:12345-0@lo:400:kworker.0 Request processed in 36us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607924.327544:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789607924.327578:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a0c2705500 x1876539541125632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607924.327589:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607924.327597:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789607924.327604:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789607924.327610:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789607924.327613:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1ee445800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789607924.327620:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1876539541125632:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789607924.327654:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a0c2701180 x1876539541125760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607924.327662:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541125760:0@lo:400:kworker.0 00000040:00080000:0.0:1789607924.341582:0:15136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789607924.341737:0:15113:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789607924.341775:0:15113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789607924.341804:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558fe00/0x33f091d001387190 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387197 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.341818:0:15113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1f558fe00/0x33f091d001387190 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387197 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789607924.341877:0:15113:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789607924.341879:0:15113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789607924.341882:0:15113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607924.341883:0:15113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607924.341884:0:15113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607924.341886:0:15113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607924.341887:0:15113:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789607924.341889:0:15113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607924.341890:0:15113:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789607924.341898:0:15113:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789607924.341900:0:15113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789607924.341901:0:15113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789607924.341902:0:15113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607924.341903:0:15113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607924.341904:0:15113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607924.341916:0:15113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607924.341918:0:15113:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789607924.341919:0:15113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607924.341920:0:15113:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789607924.341950:0:15113:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789607924.341982:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201878700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541125888:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789607924.342063:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607924.342103:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d0a9a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789607924.342236:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541125888 00000100:00100000:0.0:1789607924.342246:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541125888 00000100:00100000:0.0:1789607924.342290:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789607924.342300:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15113:x1876539541125888:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789607924.342338:0:14424:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789607924.342351:0:14424:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789607924.374383:0:14424:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789607924.374447:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789607924.377262:0:14447:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789607924.377273:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789607924.377298:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607924.377336:0:14447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1f558fc00/0x33f091d001387120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001387119 expref: 16 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607924.377345:0:14447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607924.377393:0:14447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1f558fc00/0x33f091d001387120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001387119 expref: 16 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607924.377410:0:14447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1f558fc00/0x33f091d001387120 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001387119 expref: 16 pid: 14426 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607924.377804:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14447:1876539541126016:0@lo:104: 00000100:00100000:2.0:1789607924.377878:0:14447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607924.377937:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e02b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607924.378074:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541126016 00000100:00100000:0.0:1789607924.378086:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541126016 00000100:00100000:0.0:1789607924.378139:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789607924.378148:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+3:14447:x1876539541126016:12345-0@lo:104: 00010000:00010000:0.0:1789607924.378161:0:14414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001387120 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607924.378226:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789607924.378231:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+3:14447:x1876539541126016:12345-0@lo:104: Request processed in 86us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607924.378238:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789607924.378339:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607924.378347:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001387120 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378355:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2600 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:1.0:1789607924.378360:0:14420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001387120 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378368:0:14420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001387120 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789607924.378375:0:14420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001387120 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789607924.378380:0:14420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789607924.378419:0:14420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001387120 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378464:0:14420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789607924.378491:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001387120 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378499:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2600/0x33f091d001387119 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001387120 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378519:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607924.378521:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607924.378523:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607924.378560:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3312:1876539541126144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607924.378594:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607924.378646:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541126144 00000100:00100000:1.0:1789607924.378651:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541126144 00010000:00010000:1.0:1789607924.378671:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1f558fc00/0x33f091d001387120 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001387119 expref: 17 pid: 14426 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607924.378694:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607924.378702:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201879880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:3312:x1876539541126144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607924.378728:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607924.378734:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1f558fc00/0x33f091d001387120 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001387119 expref: 17 pid: 14426 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378744:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1f558fc00/0x33f091d001387120 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001387119 expref: 17 pid: 14426 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378762:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378781:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789607924.378795:0:14416:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002046601s 00010000:00010000:1.0:1789607924.378800:0:14416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378807:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378815:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378821:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378827:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3600 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607924.378831:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378838:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378847:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607924.378857:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607924.378891:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201879880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:3312:x1876539541126144:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607924.378899:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607924.379041:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3312:1876539541126144:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607924.380406:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1f558fc00/0x33f091d001387120 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001387119 expref: 16 pid: 14426 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607924.380465:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14447:1876539541126016:0@lo:104: 00010000:00010000:2.0:1789607924.380488:0:14447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607924.380499:0:14447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607924.380507:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607924.380514:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff7e3600/0x33f091d0013871b3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607924.385666:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+15:15113:x1876539541125888:12345-0@lo:253:mount.lustre.0 Request processed in 43355us (43590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607924.385682:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789607924.385780:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201878700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15113:1876539541125888:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789607924.385800:0:15113:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789607924.385823:0:15113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789607924.385825:0:15113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789607924.385827:0:15113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607924.385829:0:15113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607924.385830:0:15113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607924.385832:0:15113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607924.385833:0:15113:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607924.385835:0:15113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607924.385837:0:15113:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789607924.385853:0:15113:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789607924.390875:0:15113:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607924.391144:0:15113:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607924.391342:0:15113:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607924.391861:0:15113:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789607924.392105:0:15113:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789607924.392324:0:15113:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789607924.393589:0:15113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789607924.454790:0:15113:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789607924.454802:0:15113:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789607924.454844:0:15113:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789607924.454923:0:15113:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789607924.454940:0:15113:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789607924.454983:0:15113:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789607924.815711:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789607925.581323:0:14428:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789607925.581331:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a0c31fe000 from 7 10000000:01000000:1.0:1789607925.581337:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789607925.581388:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607925.581402:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607925.581415:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607925.581463:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541126272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789607925.581561:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607925.581632:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1d0a9a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789607925.594479:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541126272 00000100:00100000:2.0:1789607925.594498:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541126272 00000100:00100000:2.0:1789607925.594577:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789607925.594589:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+15:14428:x1876539541126272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607925.594614:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607925.594651:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ff7e2200/0x33f091d0013871c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d0013871ba expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607925.594726:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff7e2200/0x33f091d0013871c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d0013871ba expref: 16 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607925.594743:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ff7e2200/0x33f091d0013871c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013871ba expref: 16 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607925.594754:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e2200, rc 0) 00000100:00100000:2.0:1789607925.594863:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:14428:x1876539541126272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 276us (13304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607925.594870:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789607925.595049:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541126272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607925.595070:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013871c1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607925.595081:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d0013871c1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607925.595169:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541126400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789607925.595219:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607925.595255:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e4eb3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607925.595271:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541126400 00000100:00100000:2.0:1789607925.595275:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541126400 00000100:00100000:2.0:1789607925.595304:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789607925.595310:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:14428:x1876539541126400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789607925.595326:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789607925.595344:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789607925.595347:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789607925.595488:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:14428:x1876539541126400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 176us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607925.595496:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789607925.595528:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541126400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789607925.595580:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789607925.595588:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013871c1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607925.595596:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013871c1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607925.836590:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607926.860015:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607927.883837:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607928.910584:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789607929.485454:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607929.485464:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789607929.485468:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607929.485472:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789607929.485559:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3309:1876539541126528:0@lo:400:kworker.0 00000100:00100000:0.0:1789607929.485660:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607929.485733:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607929.485740:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541126656:0@lo:400:kworker.0 00000100:00100000:0.0:1789607929.485772:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607929.485874:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541126528 00000100:00100000:0.0:1789607929.485883:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541126528 00000100:00100000:0.0:1789607929.485954:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789607929.485964:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:3309:x1876539541126528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607929.486021:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:3309:x1876539541126528:12345-0@lo:400:kworker.0 Request processed in 58us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607929.486029:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789607929.486123:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3309:1876539541126528:0@lo:400:kworker.0 00000100:00100000:2.0:1789607929.486587:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541126656 00000100:00100000:2.0:1789607929.486594:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541126656 00000100:00100000:2.0:1789607929.486636:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607929.486644:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541126656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607929.486699:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541126656:12345-0@lo:400:kworker.0 Request processed in 56us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607929.486705:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789607929.486762:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a0c2707100 x1876539541126656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789607929.486777:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541126656:0@lo:400:kworker.0 00000100:00100000:1.0:1789607929.487031:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541126784:0@lo:400:kworker.0 00000100:00100000:1.0:1789607929.487082:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607929.487141:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541126784 00000100:00100000:1.0:1789607929.487146:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541126784 00000100:00100000:1.0:1789607929.487189:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607929.487196:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541126784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607929.487236:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541126784:12345-0@lo:400:kworker.0 Request processed in 41us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607929.487243:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789607929.487304:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789607929.487330:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a0c2704e00 x1876539541126784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607929.487341:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541126784:0@lo:400:kworker.0 00010000:00010000:2.0:1789607929.950823:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607930.955703:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789607931.406529:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789607931.987485:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789607932.807088:0:15481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789607933.004060:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.038032:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607934.539673:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607919/real 1789607919] req@ffff99a0c2705180 x1876539541122944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607934 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607934.539705:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99a0c2705180 x1876539541122944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607934 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607934.539715:0:3308:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789607919/real 1789607919] req@ffff99a0c2704380 x1876539541123072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607934 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607934.539726:0:3308:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99a0c2704380 x1876539541123072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789607934 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789607934.539745:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1ceb8b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607934.539767:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789607934.539771:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541122944:0@lo:8:kworker.0 00000100:00080000:0.0:1789607934.539777:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1ffa95000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607934.539782:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789607934.539785:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541123072:0@lo:8:kworker.0 00000100:00080000:0.0:1789607934.540217:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607934.540221:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789607934.540224:0:38:0:(import.c:65:import_set_state_nolock()) ffff99a1ceb8b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607934.540229:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:0.0:1789607934.540236:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789607934.540247:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99a1ceb8b800 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1789607934.540270:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2705180 x1876539541127040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789607934.540283:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607934.540287:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789607934.540288:0:38:0:(import.c:65:import_set_state_nolock()) ffff99a1ffa95000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607934.540292:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:0.0:1789607934.540294:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789607934.540299:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a1ffa95000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1789607934.540311:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2707480 x1876539541127168/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607934.540358:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541127040:0@lo:8:kworker.0 00000100:00100000:0.0:1789607934.540461:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607934.540521:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541127168:0@lo:8:kworker.0 00000100:00100000:0.0:1789607934.540559:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607934.540587:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876539541127424:0@lo:400:kworker.0 00000100:00100000:0.0:1789607934.540616:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607934.540639:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789607934.540645:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541127296:0@lo:400:kworker.0 00000100:00100000:0.0:1789607934.540665:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607934.540694:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607934.540702:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3311:1876539541126912:0@lo:400:kworker.0 00000100:00100000:0.0:1789607934.540728:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607934.540763:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541127424 00000100:00100000:0.0:1789607934.540770:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541127424 00000100:00100000:0.0:1789607934.540816:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541127296 00000100:00100000:0.0:1789607934.540819:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541127296 00000100:00100000:0.0:1789607934.540835:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607934.540843:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876539541127424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607934.540895:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541127040 00000100:00100000:2.0:1789607934.540900:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541127040 00000100:00100000:0.0:1789607934.540905:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876539541127424:12345-0@lo:400:kworker.0 Request processed in 63us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607934.540912:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607934.540916:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541127168 00000100:00100000:2.0:1789607934.540918:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541127168 00000100:00100000:2.0:1789607934.540927:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789607934.540928:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607934.540932:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1876539541127040:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789607934.540933:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541127296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607934.540959:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1876539541127296:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607934.540964:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789607934.540966:0:15115:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00010000:00080000:0.0:1789607934.540994:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a0c2706680 x1876539541127296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1789607934.540995:0:15115:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33f091d0013871c8 00000100:00100000:0.0:1789607934.541006:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1876539541127296:0@lo:400:kworker.0 00002000:00100000:2.0:1789607934.541009:0:15115:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99a201b27000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789607934.541013:0:15115:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789607934.541016:0:15115:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1789607934.541023:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a0c2704e00 x1876539541127424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607934.541030:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876539541127424:0@lo:400:kworker.0 00000100:00080000:0.0:1789607934.541056:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:2.0:1789607934.541377:0:15115:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789607934.541399:0:15115:0:(import.c:65:import_set_state_nolock()) ffff99a201b24800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607934.541463:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876539541127040:12345-0@lo:8:kworker.0 Request processed in 529us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607934.541470:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607934.541497:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607934.541502:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1876539541127168:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789607934.541513:0:15115:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789607934.541543:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1876539541127168:12345-0@lo:8:kworker.0 Request processed in 39us (983us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789607934.541548:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789607934.541578:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541126912 00000100:00100000:2.0:1789607934.541583:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541126912 00000100:00100000:2.0:1789607934.541610:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789607934.541616:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:3311:x1876539541126912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607934.541654:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:3311:x1876539541126912:12345-0@lo:400:kworker.0 Request processed in 35us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607934.541659:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789607934.541695:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3311:1876539541126912:0@lo:400:kworker.0 00010000:00080000:0.0:1789607934.545604:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a0c2705180 x1876539541127040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607934.545620:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789607934.545629:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789607934.545639:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789607934.545645:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789607934.545649:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1ceb8b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789607934.545669:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789607934.545676:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541127040:0@lo:8:kworker.0 00000100:00080000:0.0:1789607934.545690:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1ffa95000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607934.545694:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789607934.545697:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541127168:0@lo:8:kworker.0 00000004:00080000:1.0:1789607934.545890:0:14454:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789607934.545914:0:14454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14454:1876539541127680:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789607934.545982:0:14454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607934.546014:0:14454:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e02000 going to sleep for 11 seconds 00000100:00100000:1.0:1789607934.546064:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607934.546073:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541127552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607934.546097:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607934.546138:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541127680 00000100:00100000:1.0:1789607934.546145:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541127680 00000100:00100000:1.0:1789607934.546196:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789607934.546205:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14454:x1876539541127680:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1789607934.546843:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789607934.546862:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541127552 00000100:00100000:2.0:1789607934.546880:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541127552 00000100:00100000:2.0:1789607934.546913:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607934.546920:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876539541127552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607934.546948:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607934.547005:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201878000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1876539541127552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607934.547012:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789607934.547325:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a201878a80 x1876539541127552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607934.547343:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201878a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541127552:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1789607934.548587:0:14453:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789607934.548816:0:14453:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 468393392387ns, next at 0ns, rc = 0 00002000:00080000:1.0:1789607934.559918:0:15115:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789607934.559931:0:15115:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789607934.559937:0:15115:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1789607934.577716:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.577730:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c37dd6/0x33f091d0013871cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.577751:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.577756:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.577771:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c37dd6/0x33f091d0013871cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.577794:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080c37dd6/0x33f091d0013871cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.577808:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c37dd6/0x33f091d0013871cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.577817:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080c37dd6/0x33f091d0013871cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.577850:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607934.577904:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607934.577912:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080c37dd6/0x33f091d0013871cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.577934:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efa00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607934.577940:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c37dd6/0x33f091d0013871cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.577950:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c37dd6/0x33f091d0013871cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.577970:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080c37dd6/0x33f091d0013871cf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.577977:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080c37dd6/0x33f091d0013871cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.577996:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607934.577998:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607934.578000:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.578397:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.578404:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003330bfd/0x33f091d0013871d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.578414:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.578417:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.578472:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003330bfd/0x33f091d0013871d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.578486:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003330bfd/0x33f091d0013871d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.578494:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003330bfd/0x33f091d0013871d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.578513:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003330bfd/0x33f091d0013871d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.578557:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607934.578669:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607934.578676:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003330bfd/0x33f091d0013871d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.578684:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eea00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607934.578689:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003330bfd/0x33f091d0013871d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.578698:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003330bfd/0x33f091d0013871d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.578718:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003330bfd/0x33f091d0013871d6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.578726:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003330bfd/0x33f091d0013871d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.578743:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607934.578745:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607934.578748:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.579738:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.579747:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c8a0f4a/0x33f091d0013871dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.579883:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.579887:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.579892:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c8a0f4a/0x33f091d0013871dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.579903:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c8a0f4a/0x33f091d0013871dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.579912:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c8a0f4a/0x33f091d0013871dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.579919:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c8a0f4a/0x33f091d0013871dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.579944:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607934.580030:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607934.580037:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c8a0f4a/0x33f091d0013871dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.580045:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607934.580050:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c8a0f4a/0x33f091d0013871dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.580060:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c8a0f4a/0x33f091d0013871dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.580092:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c8a0f4a/0x33f091d0013871dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.580101:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c8a0f4a/0x33f091d0013871dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.580126:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607934.580129:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607934.580131:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.583681:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.583695:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000163ddcc7/0x33f091d0013871e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.583718:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.583722:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.583728:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000163ddcc7/0x33f091d0013871e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.583744:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000163ddcc7/0x33f091d0013871e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.583767:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000163ddcc7/0x33f091d0013871e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.583777:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000163ddcc7/0x33f091d0013871e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.583807:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607934.583901:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607934.583911:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000163ddcc7/0x33f091d0013871e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.583920:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee000 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607934.583925:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000163ddcc7/0x33f091d0013871e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.584006:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000163ddcc7/0x33f091d0013871e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.584032:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000163ddcc7/0x33f091d0013871e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.584040:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000163ddcc7/0x33f091d0013871e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.584078:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607934.584080:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607934.584082:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.584293:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.584299:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d0013871eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.584308:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.584311:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.584314:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d0013871eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.584323:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d0013871eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.584340:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d0013871eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.584347:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d0013871eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.584368:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607934.584461:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607934.584467:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d0013871eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.584477:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efe00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607934.584481:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d0013871eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.584490:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d0013871eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.584503:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d0013871eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.584510:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009afc8353/0x33f091d0013871eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.584527:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607934.584529:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607934.584532:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.584817:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.584824:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075ed5006/0x33f091d0013871f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.584833:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.584836:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.584840:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075ed5006/0x33f091d0013871f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.584849:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075ed5006/0x33f091d0013871f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.584857:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075ed5006/0x33f091d0013871f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.584864:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075ed5006/0x33f091d0013871f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.584907:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607934.585029:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607934.585037:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075ed5006/0x33f091d0013871f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.585060:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efc00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607934.585064:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075ed5006/0x33f091d0013871f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.585073:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075ed5006/0x33f091d0013871f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.585086:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075ed5006/0x33f091d0013871f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.585093:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075ed5006/0x33f091d0013871f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.585108:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607934.585110:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607934.585112:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.585308:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.585313:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d0013871f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.585321:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.585325:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.585328:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d0013871f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.585336:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d0013871f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.585343:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d0013871f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.585350:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d0013871f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.585364:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607934.585373:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.585377:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d0013871f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.585383:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eec00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.585393:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d0013871f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.585400:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d0013871f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.585411:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d0013871f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.585417:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d0013871f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.585447:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.585449:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.585451:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.589475:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.589488:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d001387200 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.589505:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.589510:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.589517:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d001387200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.589532:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d001387200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.589542:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d001387200 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.589626:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d001387200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.589648:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607934.589680:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607934.589690:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d001387200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.589701:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607934.589706:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d001387200 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.589717:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d001387200 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.589743:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d001387200 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.589752:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d001387200 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.589768:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607934.589771:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607934.589772:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.591268:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.591280:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387207 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.591297:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.591302:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.591308:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.591333:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.591344:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387207 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.591351:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.591940:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789607934.592496:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.592505:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138720e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.592526:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.592530:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.592537:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138720e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.592549:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138720e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.592646:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138720e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.592653:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138720e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.593013:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607934.593023:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.593031:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef000 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607934.593036:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387207 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.593047:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387207 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.593066:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387207 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.593073:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387207 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.593108:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607934.593111:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138720e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.593117:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607934.593120:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138720e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.593127:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138720e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.593137:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138720e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.593144:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607934.593146:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607934.593148:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.593189:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789607934.593194:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138720e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607934.593509:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.594235:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.594243:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387215 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.594257:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.594262:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.594268:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.594292:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.594302:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.594731:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.594752:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607934.594780:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.594786:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.594794:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee800 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.594799:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.594817:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.594837:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387215 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.594844:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387215 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.594881:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.594883:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.594885:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.596797:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.596946:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138721c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.596967:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.596972:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.596981:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138721c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.597002:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138721c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.597016:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138721c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.597026:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138721c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.597057:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607934.597075:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.597082:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138721c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.597104:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eec00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.597108:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138721c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.597117:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138721c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.597136:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138721c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.597143:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138721c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.597161:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.597163:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.597164:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.609227:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.609245:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387223 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.609265:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.609270:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.609277:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.609294:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.609672:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387223 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.609683:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.611614:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789607934.612884:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607934.612899:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072f75783/0x33f091d00138722a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.612920:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1789607934.612925:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607934.613180:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072f75783/0x33f091d00138722a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.613212:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072f75783/0x33f091d00138722a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.613225:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072f75783/0x33f091d00138722a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.613232:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072f75783/0x33f091d00138722a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.613255:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789607934.614773:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607934.614783:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010df0d80/0x33f091d001387231 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.614798:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1789607934.614803:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607934.614810:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010df0d80/0x33f091d001387231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.614823:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010df0d80/0x33f091d001387231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.614832:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010df0d80/0x33f091d001387231 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.614851:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010df0d80/0x33f091d001387231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.614861:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789607934.621234:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789607934.621252:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008fc2e7b/0x33f091d001387238 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.621273:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1789607934.621278:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607934.621285:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008fc2e7b/0x33f091d001387238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.621303:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008fc2e7b/0x33f091d001387238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.621315:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008fc2e7b/0x33f091d001387238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.621323:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008fc2e7b/0x33f091d001387238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607934.621334:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789607934.622906:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789607934.622919:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.622934:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee800 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.622939:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387223 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.622952:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387223 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.622976:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387223 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.622983:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387223 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623008:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789607934.623012:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072f75783/0x33f091d00138722a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623028:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2adc00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.623031:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072f75783/0x33f091d00138722a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623040:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072f75783/0x33f091d00138722a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623051:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072f75783/0x33f091d00138722a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623059:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072f75783/0x33f091d00138722a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623072:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607934.623076:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010df0d80/0x33f091d001387231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623082:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac800 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.623085:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010df0d80/0x33f091d001387231 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623092:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010df0d80/0x33f091d001387231 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623101:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010df0d80/0x33f091d001387231 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623113:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010df0d80/0x33f091d001387231 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623127:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.623131:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008fc2e7b/0x33f091d001387238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623137:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.623141:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008fc2e7b/0x33f091d001387238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623149:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008fc2e7b/0x33f091d001387238 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623159:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008fc2e7b/0x33f091d001387238 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623165:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008fc2e7b/0x33f091d001387238 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.623177:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.623179:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.623181:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.623190:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.624304:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.624322:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138723f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.624340:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.624346:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.624353:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138723f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.627031:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138723f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.627062:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138723f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.627072:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138723f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.632194:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607934.632218:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.632228:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138723f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.632243:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.632248:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138723f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.632260:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138723f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.632297:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138723f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.632304:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d00138723f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.634538:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.634542:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.634544:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.635226:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.635238:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387246 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.635257:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.635262:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.635269:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.635285:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.635295:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387246 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.635303:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.635356:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789607934.636064:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607934.636074:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607934.636085:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee800 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:3.0:1789607934.636090:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387246 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607934.636102:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387246 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607934.636136:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387246 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607934.636144:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d001387246 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607934.636164:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607934.636166:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607934.636167:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.644523:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.644538:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138724d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.645509:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.645516:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.645524:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138724d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.645545:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138724d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.645663:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138724d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.645672:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138724d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.645695:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607934.645711:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.645716:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138724d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.645723:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eec00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.645734:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138724d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.645744:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138724d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.645760:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138724d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.645767:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d00138724d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.645787:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.645789:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.645790:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.649771:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.649784:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387254 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.649803:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.649808:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.649828:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.650035:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.650047:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387254 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.650062:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387254 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.650086:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789607934.651031:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.651041:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d00138725b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651054:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.651057:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.651062:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d00138725b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651074:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d00138725b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651083:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d00138725b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651090:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d00138725b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651115:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789607934.651139:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607934.651146:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387254 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651162:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.651167:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387254 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651179:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387254 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651197:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387254 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651205:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387254 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651228:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.651232:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d00138725b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651237:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef600 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.651240:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d00138725b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651247:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d00138725b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651256:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d00138725b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651271:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d00138725b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.651285:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.651287:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.651289:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607934.652000:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789607934.658843:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789607934.673627:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.673645:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d001387262 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.673668:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.673674:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.673681:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d001387262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.673700:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d001387262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.673713:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d001387262 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.673722:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d001387262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.673743:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607934.673882:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.673895:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d001387262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.673904:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eec00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.673908:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d001387262 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.673918:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d001387262 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.673935:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d001387262 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.673943:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a908035e/0x33f091d001387262 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.673958:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.673960:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.673962:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.676078:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.676095:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d001387269 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.676114:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.676119:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.676127:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d001387269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.676157:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d001387269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.676169:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d001387269 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.676177:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d001387269 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.676203:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789607934.676231:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607934.676240:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d001387269 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607934.676251:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:3.0:1789607934.676256:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d001387269 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607934.676281:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d001387269 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607934.676300:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d001387269 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607934.676309:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed3aedae/0x33f091d001387269 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607934.676344:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607934.676347:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607934.676349:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.678629:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.678648:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d001387270 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.678671:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.678676:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.678683:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d001387270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.678698:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d001387270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.678709:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d001387270 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.678729:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d001387270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.678748:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607934.680200:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.680217:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d001387270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.680235:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef600 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.680240:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d001387270 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.680251:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d001387270 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.680277:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d001387270 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.680284:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f610ecfe/0x33f091d001387270 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.680307:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.680309:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.680311:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.681052:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.681066:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387277 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.681081:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.681086:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.681093:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387277 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.681106:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387277 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.681115:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387277 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.681123:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387277 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.681140:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607934.681151:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.681156:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387277 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.681163:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.681167:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387277 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.681174:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387277 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.681194:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387277 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.681202:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000381d52ad/0x33f091d001387277 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.681214:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.681216:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.681218:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.682403:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.682414:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d00138727e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.682451:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.682455:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.682460:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d00138727e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.682475:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d00138727e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.682486:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d00138727e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.682493:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d00138727e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.682525:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607934.682540:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.682546:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d00138727e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.682555:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee800 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.682560:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d00138727e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.682569:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d00138727e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.682588:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d00138727e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.682596:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c2b1769/0x33f091d00138727e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.682615:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.682617:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.682619:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.683123:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.683129:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387285 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683137:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.683146:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.683151:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387285 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683160:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387285 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683168:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387285 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683174:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387285 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683188:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607934.683198:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.683202:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387285 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683209:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef000 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.683213:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387285 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683221:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387285 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683233:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387285 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683252:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd7e8fe2/0x33f091d001387285 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683267:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.683269:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.683271:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789607934.683784:0:15115:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789607934.683790:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d00138728c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683800:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789607934.683803:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789607934.683807:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d00138728c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683817:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d00138728c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683826:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d00138728c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683833:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d00138728c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.683846:0:15115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789607934.683854:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607934.683864:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d00138728c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1789607934.685918:0:15115:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1789607934.686050:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201879180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14454:x1876539541127680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 139841us (140061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607934.686074:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607934.686718:0:14454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14454:1876539541127680:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789607934.686739:0:14454:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789607934.686806:0:14454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14454:1876539541127808:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789607934.687041:0:14454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607934.687104:0:14454:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e4fba480 going to sleep for 11 seconds 00000100:00100000:2.0:1789607934.687133:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541127808 00000100:00100000:2.0:1789607934.687139:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541127808 00000100:00100000:2.0:1789607934.687191:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607934.687201:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14454:x1876539541127808:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789607934.687255:0:15114:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:1.0:1789607934.689338:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607934.689347:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d00138728c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.689360:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d00138728c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.689386:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d00138728c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.689394:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049d3364c/0x33f091d00138728c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607934.689439:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.689442:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607934.689445:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789607934.716741:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789607934.731370:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14454:x1876539541127808:12345-0@lo:5:osp-pre-0-0.0 Request processed in 44161us (44319us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789607934.731386:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789607934.731707:0:14454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14454:1876539541127808:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789607934.731724:0:14454:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1789607935.052898:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607936.081573:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607937.101754:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607938.126044:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607939.148188:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607939.723696:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607939.723745:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541127936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607939.723864:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607939.723987:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541127936 00000100:00100000:0.0:1789607939.723998:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541127936 00000100:00100000:0.0:1789607939.724072:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607939.724084:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541127936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789607939.724136:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789607939.724193:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541127936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607939.724202:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789607939.724228:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607939.724286:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541127936:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789607939.724749:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789607939.724755:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789607939.724762:0:37:0:(import.c:65:import_set_state_nolock()) ffff99a1ffa95000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789607939.724768:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:2.0:1789607939.724775:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789607939.724785:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a1ffa95000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1789607939.724816:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a1ff4ad500 x1876539541128192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789607939.724882:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3309:1876539541128064:0@lo:400:kworker.0 00000100:00100000:2.0:1789607939.724942:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607939.724998:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607939.725004:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541128320:0@lo:400:kworker.0 00000100:00100000:2.0:1789607939.725033:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607939.725246:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789607939.725258:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541128448:0@lo:400:kworker.0 00000100:00100000:1.0:1789607939.725298:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607939.726380:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541128192:0@lo:8:kworker.0 00000100:00100000:0.0:1789607939.726691:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541128064 00000100:00100000:0.0:1789607939.726701:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541128064 00000100:00100000:0.0:1789607939.726827:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789607939.726841:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:3309:x1876539541128064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607939.727627:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:3309:x1876539541128064:12345-0@lo:400:kworker.0 Request processed in 783us (2679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607939.727639:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789607939.727718:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541128320 00000100:00100000:0.0:1789607939.728264:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541128320 00000100:00100000:0.0:1789607939.728314:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541128448 00000100:00100000:0.0:1789607939.728318:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541128448 00000100:00100000:0.0:1789607939.728350:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607939.728359:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541128320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607939.728451:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541128320:12345-0@lo:400:kworker.0 Request processed in 92us (3416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607939.728469:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607939.728486:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607939.728493:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541128448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607939.728533:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541128448:12345-0@lo:400:kworker.0 Request processed in 41us (3234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607939.728539:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789607939.728602:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ff4ac380 x1876539541128320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607939.728623:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541128320:0@lo:400:kworker.0 00000100:00100000:0.0:1789607939.728638:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3309:1876539541128064:0@lo:400:kworker.0 00000100:00080000:0.0:1789607939.728676:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789607939.729377:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ff4aed80 x1876539541128448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789607939.729411:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541128448:0@lo:400:kworker.0 00000100:00100000:0.0:1789607939.732022:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607939.732151:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541128192 00000100:00100000:0.0:1789607939.732166:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541128192 00000100:00100000:0.0:1789607939.732224:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789607939.732237:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1876539541128192:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789607939.732272:0:15115:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789607939.765984:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1876539541128192:12345-0@lo:8:kworker.0 Request processed in 33732us (33961us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789607939.766015:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789607939.766103:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1ffa95000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789607939.766109:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789607939.766115:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541128192:0@lo:8:kworker.0 00000001:00080000:3.0:1789607939.933195:0:6718:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1789607940.172757:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607941.195975:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789607941.646324:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1789607942.118465:0:15835:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789607942.118471:0:15835:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789607942.118614:0:15835:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99a1c6582000 00000020:01000004:0.0:1789607942.118636:0:15835:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789607942.118652:0:15835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789607942.118671:0:15835:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99a1c8cf19c0) 00000020:00000080:0.0:1789607942.118692:0:15835:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789607942.171631:0:15835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789607942.172032:0:15835:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789607942.176334:0:15835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789607942.176844:0:15835:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789607942.177257:0:15835:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789607942.178038:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 549: rc = 0 00100000:10000000:3.0:1789607942.178287:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 549: rc = 0 00100000:10000000:3.0:1789607942.178385:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 549: rc = 0 00100000:10000000:3.0:1789607942.179330:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 451: rc = 0 00100000:10000000:3.0:1789607942.184520:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 451: rc = 0 00100000:10000000:3.0:1789607942.184978:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 451: rc = 0 00100000:10000000:3.0:1789607942.188261:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 451: rc = 0 00100000:10000000:3.0:1789607942.189759:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 451: rc = 0 00100000:10000000:3.0:1789607942.190341:0:15835:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 451: rc = 0 00000020:00000080:3.0:1789607942.193696:0:15835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789607942.193714:0:15835:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789607942.193731:0:15835:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x33f091d00138729a 00000020:01000004:3.0:1789607942.193744:0:15835:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789607942.193773:0:15835:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789607942.193777:0:15835:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789607942.193809:0:15835:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789607942.193845:0:15835:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789607942.193851:0:15835:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00010000:00010000:0.0:1789607942.220418:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789607942.234991:0:15835:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789607942.236140:0:15835:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.103@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789607942.236150:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789607942.236152:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789607942.236153:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607942.236154:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607942.236155:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607942.236157:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607942.236158:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607942.236160:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607942.236161:0:15835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789607942.236166:0:15835:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789607942.236168:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789607942.236170:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789607942.236171:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789607942.236173:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789607942.236174:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789607942.236176:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789607942.236177:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789607942.236178:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789607942.236178:0:15835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789607942.236218:0:15835:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789607942.236247:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541128576:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789607942.236325:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607942.236544:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541128576 00000100:00100000:2.0:1789607942.236553:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541128576 00000100:00100000:2.0:1789607942.236599:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789607942.236607:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15835:x1876539541128576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789607942.236652:0:14425:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789607942.236655:0:14425:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789607942.236658:0:14425:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789607942.236744:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a200ceb900 going to sleep for 11 seconds 00000100:00100000:2.0:1789607942.278509:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15835:x1876539541128576:12345-0@lo:253:mount.lustre.0 Request processed in 41890us (42171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607942.278525:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789607942.278866:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541128576:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789607942.278886:0:15835:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789607942.278890:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789607942.278892:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789607942.278894:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789607942.278895:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789607942.278897:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789607942.278898:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789607942.278900:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789607942.278902:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789607942.278903:0:15835:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789607942.278931:0:15835:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99a1c6582000 from lustre-OST0001 10000000:01000000:0.0:1789607942.278970:0:15835:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789607942.278974:0:15835:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789607942.278996:0:15835:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99a1f61a4d40 local copy 00010000:00010000:0.0:1789607942.279011:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387047 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607942.279899:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541128704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607942.279958:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607942.280079:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c532c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789607942.286539:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541128704 00000100:00100000:2.0:1789607942.286557:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541128704 00000100:00100000:3.0:1789607942.290286:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789607942.290303:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15835:x1876539541128704:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607942.290963:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15835:x1876539541128704:12345-0@lo:501:mount.lustre.0 Request processed in 661us (11002us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789607942.290973:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789607942.291566:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541128704:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789607942.291593:0:15835:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789607942.291776:0:15835:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789607942.291788:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387047 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607942.291812:0:15835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1f558ec00/0x33f091d001387040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387047 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607942.291843:0:15835:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99a1c6582000 10000000:01000000:0.0:1789607942.291848:0:15835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789607942.291853:0:15835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789607942.291856:0:15835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789607942.291861:0:15835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789607942.291864:0:15835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789607942.291898:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ade00/0x33f091d0013872a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607942.291907:0:15835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ade00/0x33f091d0013872a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607942.291919:0:15835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ade00/0x33f091d0013872a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607942.291953:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541128832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789607942.292005:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607942.292598:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c532c000 going to sleep for 11 seconds 00000100:00100000:2.0:1789607942.295608:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541128832 00000100:00100000:2.0:1789607942.295633:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541128832 00000100:00100000:3.0:1789607942.296663:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789607942.296698:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:15835:x1876539541128832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607942.296735:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607942.296764:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558e800/0x33f091d0013872a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d0013872a1 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.296811:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558e800/0x33f091d0013872a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d0013872a1 expref: 17 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.296826:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558e800/0x33f091d0013872a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013872a1 expref: 17 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.296837:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558e800, rc 0) 00000100:00100000:3.0:1789607942.296957:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:15835:x1876539541128832:12345-0@lo:101:mount.lustre.0 Request processed in 265us (4951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607942.296964:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789607942.297103:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2704e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541128832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607942.297125:0:15835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ade00/0x33f091d0013872a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013872a8 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607942.297136:0:15835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ade00/0x33f091d0013872a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d0013872a8 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789607942.298009:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789607942.299005:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607942.299266:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789607942.299317:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789607942.299349:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789607942.299395:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789607942.299466:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789607942.299500:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789607942.299570:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789607942.299579:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789607942.299726:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541128960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607942.299838:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607942.308093:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607942.308709:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541128960 00000100:00100000:0.0:1789607942.308720:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541128960 00000100:00100000:0.0:1789607942.308775:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789607942.308785:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:15835:x1876539541128960:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607942.311937:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:15835:x1876539541128960:12345-0@lo:501:mount.lustre.0 Request processed in 3142us (12088us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607942.311950:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789607942.312103:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541128960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607942.312158:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607942.312211:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607942.312261:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607942.312458:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541129088 00000100:00100000:3.0:1789607942.312466:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541129088 00000100:00100000:3.0:1789607942.312514:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789607942.312522:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:15835:x1876539541129088:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607942.312871:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:15835:x1876539541129088:12345-0@lo:503:mount.lustre.0 Request processed in 349us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607942.312878:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789607942.313168:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129088:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789607942.314076:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789607942.314161:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129216:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607942.314227:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607942.314265:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607942.314590:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541129216 00000100:00100000:0.0:1789607942.314599:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541129216 00000100:00100000:0.0:1789607942.314637:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789607942.314645:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:15835:x1876539541129216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789607942.314917:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:15835:x1876539541129216:12345-0@lo:502:mount.lustre.0 Request processed in 271us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607942.314925:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789607942.315201:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789607942.315511:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789607942.315569:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789607942.315604:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789607942.315651:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789607942.315686:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789607942.315714:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789607942.315754:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789607942.315786:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789607942.315848:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789607942.315891:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607942.315961:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607942.316279:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541129344 00000100:00100000:3.0:1789607942.316291:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541129344 00000100:00100000:3.0:1789607942.316339:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789607942.316348:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:15835:x1876539541129344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607942.316813:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607942.321575:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:15835:x1876539541129344:12345-0@lo:502:mount.lustre.0 Request processed in 5217us (5605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607942.321606:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789607942.322807:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789607942.322971:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789607942.323529:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789607942.331179:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789607942.331193:0:15836:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789607942.331201:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789607942.331204:0:15836:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789607942.331210:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789607942.331230:0:15836:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99a1e4c80000) 00000020:00000080:2.0:1789607942.331262:0:15836:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789607942.331269:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789607942.331344:0:15836:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a1c6582000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789607942.331354:0:15836:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789607942.331362:0:15836:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x33f091d0013872b6 00010000:00010000:2.0:1789607942.337263:0:15836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789607942.338120:0:15836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1789607942.342959:0:15836:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789607942.367371:0:15836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789607942.367386:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607942.367393:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607942.367396:0:15836:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789607942.367400:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607942.367404:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607942.367412:0:15836:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789607942.367416:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789607942.367418:0:15836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789607942.367459:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607942.367463:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607942.367465:0:15836:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789607942.367467:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789607942.367470:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607942.367472:0:15836:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789607942.367475:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789607942.367558:0:15836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789607942.367561:0:15836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789607942.367563:0:15836:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789607942.367566:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789607942.371174:0:15835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789607942.371237:0:15835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789607942.371266:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ade00/0x33f091d0013872a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013872a8 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.371283:0:15835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ee2ade00/0x33f091d0013872a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013872a8 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607942.371304:0:15835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1c6582000 from 1 10000000:01000000:2.0:1789607942.371307:0:15835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607942.371354:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.371363:0:15835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.371375:0:15835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607942.371412:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607942.371538:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607942.371585:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e4eb3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789607942.372604:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541129472 00000100:00100000:2.0:1789607942.372617:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541129472 00000100:00100000:2.0:1789607942.372685:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789607942.372697:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:15835:x1876539541129472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789607942.372715:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607942.372736:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ff7e2800/0x33f091d0013872c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d0013872bd expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.372770:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff7e2800/0x33f091d0013872c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d0013872bd expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.372784:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ff7e2800/0x33f091d0013872c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013872bd expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.372805:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff7e2800, rc 0) 00000100:00100000:2.0:1789607942.372878:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:15835:x1876539541129472:12345-0@lo:101:mount.lustre.0 Request processed in 183us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607942.372885:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789607942.372996:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789607942.373016:0:15835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013872c4 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607942.373027:0:15835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d0013872c4 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789607942.373853:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789607942.374658:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789607942.374921:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789607942.374969:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789607942.376670:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789607942.376688:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789607942.376813:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607942.376884:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607942.376958:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541129600 00000100:00100000:1.0:1789607942.376968:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541129600 00000100:00100000:0.0:1789607942.377375:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e023c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789607942.379203:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789607942.379233:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:15835:x1876539541129600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789607942.379596:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:15835:x1876539541129600:12345-0@lo:501:mount.lustre.0 Request processed in 371us (2710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607942.379604:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789607942.380205:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607942.380276:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129728:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607942.380336:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607942.386514:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873300 going to sleep for 11 seconds 00000100:00100000:2.0:1789607942.386945:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541129728 00000100:00100000:2.0:1789607942.386957:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541129728 00000100:00100000:2.0:1789607942.387021:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789607942.387031:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:15835:x1876539541129728:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789607942.387771:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:15835:x1876539541129728:12345-0@lo:503:mount.lustre.0 Request processed in 738us (7431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607942.387790:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789607942.387976:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129728:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789607942.388926:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607942.389143:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607942.389215:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607942.389253:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873300 going to sleep for 11 seconds 00000100:00100000:2.0:1789607942.389350:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541129856 00000100:00100000:2.0:1789607942.389358:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541129856 00000100:00100000:2.0:1789607942.389393:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789607942.389402:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:15835:x1876539541129856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607942.389930:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:15835:x1876539541129856:12345-0@lo:502:mount.lustre.0 Request processed in 528us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607942.389939:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789607942.390216:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607942.390706:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789607942.390766:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789607942.390828:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789607942.390866:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789607942.390899:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789607942.390951:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789607942.391189:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789607942.391235:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789607942.391272:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607942.391331:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607942.391362:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873300 going to sleep for 11 seconds 00000100:00100000:2.0:1789607942.391457:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541129984 00000100:00100000:2.0:1789607942.391464:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541129984 00000100:00100000:2.0:1789607942.391510:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789607942.391518:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:15835:x1876539541129984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789607942.391696:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:15835:x1876539541129984:12345-0@lo:502:mount.lustre.0 Request processed in 178us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607942.391704:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789607942.392058:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541129984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789607942.392176:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789607942.392187:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789607942.393865:0:15840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607942.393879:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607942.393881:0:15840:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789607942.393888:0:15840:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a1c6582000 00000020:00000080:3.0:1789607942.393891:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607942.393899:0:15840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607942.393901:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607942.393902:0:15840:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789607942.393905:0:15840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607942.393907:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607942.393908:0:15840:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789607942.393911:0:15840:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a1c6582000 00000020:00000080:3.0:1789607942.393913:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607942.394189:0:15840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607942.394194:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607942.394196:0:15840:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789607942.394199:0:15840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789607942.394202:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607942.394203:0:15840:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789607942.394207:0:15840:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99a1c6582000 00000020:00000080:3.0:1789607942.394210:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789607942.400953:0:15840:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789607942.400969:0:15840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789607942.400972:0:15840:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789607942.400977:0:15840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789607942.401140:0:15835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789607942.401179:0:15835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607942.401207:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013872c4 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.401221:0:15835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013872c4 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607942.401290:0:15835:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789607942.401293:0:15835:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99a1c6582000 10000000:01000000:2.0:1789607942.401296:0:15835:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99a1c6582000 10000000:01000000:2.0:1789607942.401300:0:15835:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789607942.401316:0:15835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a1c6582000 from 1 10000000:01000000:2.0:1789607942.401319:0:15835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789607942.401363:0:15835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3000/0x33f091d0013872cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.401372:0:15835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3000/0x33f091d0013872cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.401386:0:15835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3000/0x33f091d0013872cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607942.401449:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541130112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789607942.401536:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607942.401580:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607942.403720:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541130112 00000100:00100000:0.0:1789607942.403738:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541130112 00000100:00100000:0.0:1789607942.403823:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789607942.403835:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:15835:x1876539541130112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789607942.403853:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607942.403874:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ee2ac000/0x33f091d0013872d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d0013872cb expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607942.403914:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ee2ac000/0x33f091d0013872d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d0013872cb expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607942.403926:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ee2ac000/0x33f091d0013872d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013872cb expref: 19 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607942.403936:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ac000, rc 0) 00000100:00100000:0.0:1789607942.404019:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:15835:x1876539541130112:12345-0@lo:101:mount.lustre.0 Request processed in 187us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607942.404025:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789607942.405639:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541130112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789607942.405677:0:15835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3000/0x33f091d0013872cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013872d2 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.405692:0:15835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3000/0x33f091d0013872cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d0013872d2 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789607942.411346:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789607942.414365:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789607942.415827:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789607942.415888:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789607942.415924:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789607942.415972:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789607942.416010:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789607942.416082:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789607942.416120:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789607942.416155:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789607942.416204:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789607942.416239:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789607942.416270:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789607942.416317:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789607942.416354:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789607942.416387:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789607942.416461:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789607942.416497:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789607942.416532:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789607942.416584:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789607942.416621:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789607942.416654:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789607942.416700:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789607942.416757:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789607942.416787:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789607942.421964:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789607942.422032:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789607942.422071:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789607942.422122:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789607942.422160:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789607942.422193:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789607942.422266:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789607942.422303:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789607942.422337:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789607942.422371:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789607942.422465:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789607942.422748:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789607942.422817:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789607942.422855:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789607942.422975:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789607942.422983:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789607942.423105:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541130240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607942.423185:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607942.423236:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873300 going to sleep for 11 seconds 00000100:00100000:0.0:1789607942.428720:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541130240 00000100:00100000:0.0:1789607942.428734:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541130240 00000100:00100000:0.0:1789607942.428815:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789607942.428827:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:15835:x1876539541130240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789607942.429191:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:15835:x1876539541130240:12345-0@lo:501:mount.lustre.0 Request processed in 365us (6004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607942.429200:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789607942.430703:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541130240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789607942.430786:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541130368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789607942.430879:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607942.430922:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607942.430996:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541130368 00000100:00100000:1.0:1789607942.431005:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541130368 00000100:00100000:1.0:1789607942.431067:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789607942.431078:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:15835:x1876539541130368:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789607942.431971:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:15835:x1876539541130368:12345-0@lo:503:mount.lustre.0 Request processed in 892us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607942.431982:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789607942.436326:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541130368:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789607942.437007:0:15835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789607942.437090:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541130496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607942.437175:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607942.437231:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee873300 going to sleep for 11 seconds 00000100:00100000:1.0:1789607942.438419:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541130496 00000100:00100000:1.0:1789607942.438694:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541130496 00000100:00100000:1.0:1789607942.438764:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789607942.438776:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:15835:x1876539541130496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607942.444844:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:15835:x1876539541130496:12345-0@lo:502:mount.lustre.0 Request processed in 6051us (7650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607942.444867:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789607942.445067:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541130496:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789607942.445410:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789607942.445655:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789607942.445695:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789607942.445746:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789607942.445785:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789607942.445846:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789607942.445884:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789607942.445919:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789607942.445966:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789607942.446018:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789607942.446052:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789607942.446101:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789607942.446138:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789607942.446174:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789607942.446225:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789607942.446279:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789607942.446313:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789607942.446363:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789607942.446398:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789607942.446464:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789607942.447741:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789607942.447832:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789607942.447873:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789607942.447923:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789607942.447958:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789607942.447985:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789607942.448033:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789607942.448071:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789607942.448106:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789607942.448157:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789607942.448208:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789607942.448238:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789607942.448266:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789607942.448311:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789607942.448346:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789607942.448393:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789607942.448460:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1789607942.448860:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1789607942.448944:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1789607942.448985:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1789607942.449037:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a20187b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541130624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789607942.449134:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607942.449187:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff9a1300 going to sleep for 11 seconds 00000100:00100000:3.0:1789607942.449285:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541130624 00000100:00100000:3.0:1789607942.449293:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541130624 00000100:00100000:3.0:1789607942.449350:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789607942.449360:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1eeb21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:15835:x1876539541130624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789607942.449636:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1eeb21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:15835:x1876539541130624:12345-0@lo:502:mount.lustre.0 Request processed in 277us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607942.449652:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789607942.449937:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a20187b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541130624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789607942.450023:0:15835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789607942.450034:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789607942.451917:0:15845:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789607942.451937:0:15845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99a1c8cf3380) 00000020:00000080:0.0:1789607942.452205:0:15845:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789607942.452285:0:15845:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a1c6582000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789607942.452290:0:15845:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a1c6582000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789607942.452293:0:15845:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a1c6582000 3 00010000:00080000:0.0:1789607942.452326:0:15845:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a1ee446000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.103@tcp at head 00010000:00010000:2.0:1789607942.454897:0:15845:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789607942.455193:0:15845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789607942.455244:0:15845:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789607942.455266:0:15845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x33f091d0013872e0 00000100:00080000:2.0:1789607942.455277:0:15845:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789607942.455291:0:15845:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99a1ee446000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:2.0:1789607942.455335:0:15845:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a1ff4af100 x1876539541130752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789607942.455369:0:15845:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789607942.455479:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876539541130752:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789607942.455647:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789607942.455734:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789607942.455738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789607942.455741:0:37:0:(import.c:65:import_set_state_nolock()) ffff99a1ffa95000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789607942.455745:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:3.0:1789607942.455748:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789607942.455753:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a1ffa95000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:3.0:1789607942.455765:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2703800 x1876539541131008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789607942.455916:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541131008:0@lo:8:kworker.0 00000100:00100000:3.0:1789607942.455942:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607942.457225:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541131008 00000100:00100000:1.0:1789607942.457238:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541131008 00000100:00100000:1.0:1789607942.457286:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607942.457295:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1876539541131008:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789607942.457384:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1876539541131008:12345-0@lo:8:kworker.0 Request processed in 89us (1440us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789607942.457391:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607942.457437:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541130880:0@lo:400:kworker.0 00000100:00100000:1.0:1789607942.457470:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607942.457747:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541130880 00000100:00100000:1.0:1789607942.457752:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541130880 00000100:00100000:1.0:1789607942.457815:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789607942.457822:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541130880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607942.457888:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541130880:12345-0@lo:400:kworker.0 Request processed in 66us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607942.457894:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789607942.457914:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607942.457945:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789607942.457964:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541130880:0@lo:400:kworker.0 00000100:00100000:3.0:1789607942.458275:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607942.458282:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1ffa95000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789607942.458286:0:3308:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789607942.458290:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541131008:0@lo:8:kworker.0 00000100:00100000:2.0:1789607942.459236:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541130752 00000100:00100000:2.0:1789607942.459246:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541130752 00000100:00100000:2.0:1789607942.459287:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789607942.459293:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1876539541130752:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789607942.459317:0:14430:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:2.0:1789607942.459363:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x33f091d0013872e7 00000004:00100000:2.0:1789607942.459389:0:14430:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789607942.459459:0:14430:0:(import.c:65:import_set_state_nolock()) ffff99a1ff7e9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789607942.459642:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876539541130752:12345-0@lo:38:llog_process_th.0 Request processed in 348us (3994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607942.459650:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:2.0:1789607942.459973:0:15845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789607942.460241:0:15835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789607942.460286:0:15835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789607942.460304:0:15835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3000/0x33f091d0013872cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013872d2 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607942.460317:0:15835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3000/0x33f091d0013872cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013872d2 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789607942.460365:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789607942.460367:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789607942.460369:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607942.460370:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607942.460371:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607942.460373:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607942.460374:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789607942.460376:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607942.460377:0:15835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789607942.460381:0:15835:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789607942.460383:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789607942.460385:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789607942.460386:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607942.460387:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607942.460388:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607942.460389:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607942.460391:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789607942.460392:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607942.460393:0:15835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789607942.460418:0:15835:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789607942.460454:0:15835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a201879500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541131392:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789607942.460631:0:15835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607942.460675:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541131392 00000100:00100000:1.0:1789607942.460684:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541131392 00000100:00100000:1.0:1789607942.460731:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789607942.460740:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:15835:x1876539541131392:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789607942.460764:0:14424:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789607942.460783:0:14424:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1789607942.461672:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a1ff4af100 x1876539541130752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789607952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607942.461687:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789607942.461698:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789607942.461708:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789607942.461715:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789607942.461718:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1ee446000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789607942.461735:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1876539541130752:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789607942.461996:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541131136:0@lo:400:kworker.0 00000100:00100000:0.0:1789607942.462052:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607942.462130:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607942.462137:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876539541131264:0@lo:400:kworker.0 00000100:00100000:0.0:1789607942.462163:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607942.462288:0:15835:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ff9a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789607942.478335:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541131136 00000100:00100000:2.0:1789607942.478350:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541131136 00000100:00100000:2.0:1789607942.478525:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541131264 00000100:00100000:2.0:1789607942.478529:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541131264 00000100:00100000:2.0:1789607942.478563:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607942.478572:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541131136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607942.478652:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541131136:12345-0@lo:400:kworker.0 Request processed in 82us (16600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607942.478660:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607942.478682:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607942.478688:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876539541131264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607942.478717:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876539541131264:12345-0@lo:400:kworker.0 Request processed in 29us (16553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607942.478723:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789607942.478739:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789607942.479037:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a0c2702300 x1876539541131264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607942.479053:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1876539541131264:0@lo:400:kworker.0 00010000:00080000:0.0:1789607942.479066:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a0c2701500 x1876539541131136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607942.479074:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541131136:0@lo:400:kworker.0 20000000:01000000:0.0:1789607942.518950:0:14424:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789607942.518976:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789607942.519520:0:14447:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789607942.519526:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789607942.519556:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.519575:0:14447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1ff7e2200/0x33f091d0013871c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013871ba expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.519599:0:14447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.519635:0:14447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1ff7e2200/0x33f091d0013871c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d0013871ba expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.519650:0:14447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1ff7e2200/0x33f091d0013871c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d0013871ba expref: 19 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607942.519663:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ace00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14447:1876539541131520:0@lo:104: 00000100:00100000:2.0:1789607942.519726:0:14447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607942.519785:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1ee72a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607942.519871:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541131520 00000100:00100000:0.0:1789607942.519881:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541131520 00000100:00100000:0.0:1789607942.519946:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607942.519955:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+3:14447:x1876539541131520:12345-0@lo:104: 00010000:00010000:0.0:1789607942.519969:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013871c1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607942.520060:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789607942.520067:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+3:14447:x1876539541131520:12345-0@lo:104: Request processed in 114us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607942.520078:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789607942.520268:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607942.520275:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013871c1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607942.520283:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef800 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:0.0:1789607942.520288:0:14420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d0013871c1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607942.520297:0:14420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d0013871c1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789607942.520306:0:14420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d0013871c1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789607942.520312:0:14420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789607942.520344:0:14420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013871c1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607942.520357:0:14420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789607942.520379:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013871c1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607942.520387:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1ff4ef800/0x33f091d0013871ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013871c1 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607942.520490:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607942.520493:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607942.520494:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607942.520510:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3311:1876539541131648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607942.520542:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607942.520805:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ace00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14447:1876539541131520:0@lo:104: 00010000:00010000:2.0:1789607942.520833:0:14447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607942.521022:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541131648 00000100:00100000:3.0:1789607942.521036:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541131648 00010000:00010000:3.0:1789607942.521085:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1ff7e2200/0x33f091d0013871c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d0013871ba expref: 20 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607942.521126:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607942.521137:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+20:3311:x1876539541131648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789607942.521155:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607942.521162:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1ff7e2200/0x33f091d0013871c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d0013871ba expref: 20 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.521177:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1ff7e2200/0x33f091d0013871c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d0013871ba expref: 20 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.521197:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff7e2200/0x33f091d0013871c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d0013871ba expref: 20 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.521228:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.521238:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789607942.521260:0:14416:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002046601s 00010000:00010000:3.0:1789607942.521266:0:14416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.521274:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.521300:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.521308:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.521314:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3c00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:3.0:1789607942.521319:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.521328:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.521347:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607942.521359:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607942.521387:0:14447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.521398:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607942.521406:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff7e3c00/0x33f091d0013872ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607942.521476:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2704000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:3311:x1876539541131648:12345-0@lo:103:ldlm_bl.0 Request processed in 340us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607942.521485:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789607942.521775:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3311:1876539541131648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789607942.545865:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5002c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:15835:x1876539541131392:12345-0@lo:253:mount.lustre.0 Request processed in 85110us (85218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607942.545885:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789607942.545952:0:15835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a201879500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:15835:1876539541131392:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789607942.545979:0:15835:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789607942.545983:0:15835:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789607942.545984:0:15835:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789607942.545985:0:15835:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789607942.545987:0:15835:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789607942.545989:0:15835:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789607942.545990:0:15835:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789607942.545992:0:15835:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789607942.545994:0:15835:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789607942.545996:0:15835:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789607942.546014:0:15835:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789607942.554061:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607942.554241:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789607942.554409:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607942.554631:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789607942.554816:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789607942.555074:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789607942.563393:0:15835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789607942.745226:0:15835:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789607942.745238:0:15835:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789607942.745280:0:15835:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789607942.745364:0:15835:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.103@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789607942.745390:0:15835:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789607942.745453:0:15835:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789607943.246199:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789607943.947551:0:14428:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789607943.947564:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a0c31fe000 from 8 10000000:01000000:3.0:1789607943.947571:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789607943.947645:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558e400/0x33f091d0013872f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607943.947660:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1f558e400/0x33f091d0013872f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607943.947675:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1f558e400/0x33f091d0013872f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607943.947740:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2703800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541131776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607943.947860:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607943.947939:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20d0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607943.947946:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541131776 00000100:00100000:1.0:1789607943.947964:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541131776 00000100:00100000:1.0:1789607943.948050:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789607943.948061:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:14428:x1876539541131776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789607943.948083:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607943.948107:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ff4ef800/0x33f091d0013872fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d0013872f5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607943.948139:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff4ef800/0x33f091d0013872fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d0013872f5 expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607943.948152:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ff4ef800/0x33f091d0013872fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013872f5 expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607943.948163:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef800, rc 0) 00000100:00100000:1.0:1789607943.948269:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5003450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:14428:x1876539541131776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607943.948285:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789607943.948322:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2703800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541131776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607943.948356:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1f558e400/0x33f091d0013872f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013872fc expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607943.948369:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1f558e400/0x33f091d0013872f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d0013872fc expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607943.948461:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2703800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541131904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789607943.948511:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607943.948542:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c20d0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789607943.948694:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541131904 00000100:00100000:1.0:1789607943.948701:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541131904 00000100:00100000:1.0:1789607943.948736:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789607943.948744:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:14428:x1876539541131904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789607943.948758:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789607943.948788:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789607943.948791:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789607943.948886:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5000c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:14428:x1876539541131904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607943.948893:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789607943.948935:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2703800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541131904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789607943.949032:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789607943.949041:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1f558e400/0x33f091d0013872f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013872fc expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607943.949051:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1f558e400/0x33f091d0013872f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d0013872fc expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607944.269015:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607944.847494:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789607944.847519:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541132032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607944.847608:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607944.847961:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541132032 00000100:00100000:2.0:1789607944.847971:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541132032 00000100:00100000:2.0:1789607944.848040:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607944.848051:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541132032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607944.848089:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607944.848145:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201879500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541132032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607944.848152:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789607944.848204:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541132032:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789607944.848272:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789607945.293190:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607946.321708:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607947.340005:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789607947.915814:0:15915:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789607947.915820:0:15915:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789607947.915824:0:15915:0:(import.c:65:import_set_state_nolock()) ffff99a1ffa95000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789607947.915842:0:15915:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a1ffa95000 using connection 192.168.202.103@tcp/0@lo 00000100:00100000:0.0:1789607947.915867:0:15915:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a0c2705c00 x1876539541132416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789607947.915982:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541132288:0@lo:400:kworker.0 00000100:00100000:0.0:1789607947.916050:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607947.916117:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789607947.916139:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3310:1876539541132160:0@lo:400:kworker.0 00000100:00100000:0.0:1789607947.916175:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607947.916203:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541132800:0@lo:400:kworker.0 00000100:00100000:0.0:1789607947.916231:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607947.916257:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541132416:0@lo:8:kworker.0 00000100:00100000:0.0:1789607947.916280:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607947.916310:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541132544:0@lo:400:kworker.0 00000100:00100000:0.0:1789607947.916331:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607947.916355:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789607947.916360:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541132672:0@lo:400:kworker.0 00000100:00100000:0.0:1789607947.916380:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607947.916411:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541132288 00000100:00100000:0.0:1789607947.916419:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541132288 00000100:00100000:0.0:1789607947.916485:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541132416 00000100:00100000:0.0:1789607947.916488:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541132416 00000100:00100000:0.0:1789607947.916500:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607947.916508:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541132288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607947.916563:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541132288:12345-0@lo:400:kworker.0 Request processed in 56us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607947.916570:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607947.916585:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607947.916589:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1876539541132416:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789607947.916611:0:15114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:0.0:1789607947.916641:0:15114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x33f091d001387303 00002000:00100000:0.0:1789607947.916656:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99a1ee442000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789607947.916660:0:15114:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789607947.916670:0:15114:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789607947.917030:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789607947.917061:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99a1ee447000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607947.917109:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1876539541132416:12345-0@lo:8:kworker.0 Request processed in 518us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607947.917115:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789607947.917149:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541132160 00000100:00100000:0.0:1789607947.917153:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541132160 00000100:00100000:0.0:1789607947.917177:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789607947.917184:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:3310:x1876539541132160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607947.917216:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5003050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:3310:x1876539541132160:12345-0@lo:400:kworker.0 Request processed in 32us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607947.917222:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789607947.917250:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541132800 00000100:00100000:0.0:1789607947.917253:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541132800 00000100:00100000:0.0:1789607947.917276:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541132544 00000100:00100000:0.0:1789607947.917278:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541132544 00000100:00100000:0.0:1789607947.917291:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541132672 00000100:00100000:0.0:1789607947.917294:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541132672 00000100:00100000:0.0:1789607947.917308:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789607947.917314:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541132800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607947.917345:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541132800:12345-0@lo:400:kworker.0 Request processed in 31us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607947.917350:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789607947.917362:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789607947.917367:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541132544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607947.917396:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541132544:12345-0@lo:400:kworker.0 Request processed in 29us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607947.917415:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789607947.917450:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607947.917456:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541132672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607947.917483:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541132672:12345-0@lo:400:kworker.0 Request processed in 27us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607947.917487:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789607947.917511:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607947.917515:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789607947.917544:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a0c2705c00 x1876539541132416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789607972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789607947.917562:0:3308:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789607947.917568:0:3308:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789607947.917574:0:3308:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789607947.917576:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a1ffa95000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789607947.917591:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789607947.917596:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1876539541132416:0@lo:8:kworker.0 00010000:00080000:0.0:1789607947.917627:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a0c2704700 x1876539541132672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607947.917636:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541132672:0@lo:400:kworker.0 00010000:00080000:0.0:1789607947.917645:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a0c2704a80 x1876539541132544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607947.917653:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541132544:0@lo:400:kworker.0 00000100:00100000:0.0:1789607947.917677:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3310:1876539541132160:0@lo:400:kworker.0 00010000:00080000:0.0:1789607947.917688:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a0c2704e00 x1876539541132800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789607963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789607947.917704:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541132800:0@lo:400:kworker.0 00000100:00100000:0.0:1789607947.917716:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541132288:0@lo:400:kworker.0 00000004:00080000:2.0:1789607947.921110:0:14456:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789607947.921142:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14456:1876539541133056:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789607947.921208:0:14456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607947.921236:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a200cebcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607947.921266:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541133056 00000100:00100000:2.0:1789607947.921273:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541133056 00000100:00100000:2.0:1789607947.921326:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607947.921333:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14456:x1876539541133056:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789607947.921796:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607947.921809:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541132928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607947.921841:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607947.921876:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541132928 00000100:00100000:3.0:1789607947.921888:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541132928 00000100:00100000:3.0:1789607947.921920:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607947.921928:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876539541132928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607947.921953:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607947.921998:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1876539541132928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607947.922004:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789607947.922044:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a1ff4ace00 x1876539541132928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789607963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789607947.922061:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541132928:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789607947.924848:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789607947.925439:0:14455:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789607947.925882:0:14455:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 481770458551ns, next at 0ns, rc = 0 00002000:00080000:2.0:1789607947.942530:0:15114:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789607947.942546:0:15114:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789607947.942554:0:15114:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1789607947.956284:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607947.956303:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d00138730a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.956334:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607947.956340:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607947.956347:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d00138730a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.956368:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d00138730a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.956380:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d00138730a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.956388:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d00138730a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.956412:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607947.957104:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607947.957118:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d00138730a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.957129:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3e00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607947.957134:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d00138730a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.957145:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d00138730a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.957174:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d00138730a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.957182:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d00138730a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.957212:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607947.957214:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607947.957216:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607947.971486:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607947.971499:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008523ba00/0x33f091d001387311 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.971516:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607947.971521:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607947.971527:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008523ba00/0x33f091d001387311 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.971543:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008523ba00/0x33f091d001387311 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.971565:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008523ba00/0x33f091d001387311 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.971572:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008523ba00/0x33f091d001387311 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.971594:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607947.971607:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607947.971612:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008523ba00/0x33f091d001387311 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.971620:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2600 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607947.971625:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008523ba00/0x33f091d001387311 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.971633:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008523ba00/0x33f091d001387311 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.971650:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008523ba00/0x33f091d001387311 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.971657:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008523ba00/0x33f091d001387311 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.971675:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607947.971774:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607947.971777:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607947.972089:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607947.972093:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c0757a2/0x33f091d001387318 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972100:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607947.972102:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607947.972105:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c0757a2/0x33f091d001387318 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972111:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c0757a2/0x33f091d001387318 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972116:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c0757a2/0x33f091d001387318 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972120:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c0757a2/0x33f091d001387318 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972131:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607947.972138:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607947.972142:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c0757a2/0x33f091d001387318 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972149:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3600 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607947.972152:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c0757a2/0x33f091d001387318 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972171:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c0757a2/0x33f091d001387318 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972182:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c0757a2/0x33f091d001387318 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972189:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c0757a2/0x33f091d001387318 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972202:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607947.972203:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607947.972205:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607947.972585:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607947.972590:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085cf1a49/0x33f091d00138731f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972596:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607947.972598:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607947.972601:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085cf1a49/0x33f091d00138731f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972607:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085cf1a49/0x33f091d00138731f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972611:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085cf1a49/0x33f091d00138731f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972620:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085cf1a49/0x33f091d00138731f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972630:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607947.972636:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607947.972638:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085cf1a49/0x33f091d00138731f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972643:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3c00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607947.972645:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085cf1a49/0x33f091d00138731f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972649:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085cf1a49/0x33f091d00138731f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972656:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085cf1a49/0x33f091d00138731f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972660:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085cf1a49/0x33f091d00138731f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.972668:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607947.972669:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607947.972670:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607947.979836:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607947.979870:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008474eba8/0x33f091d001387326 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.979887:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607947.979892:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607947.979898:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008474eba8/0x33f091d001387326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.979913:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008474eba8/0x33f091d001387326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.979924:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008474eba8/0x33f091d001387326 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.979932:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008474eba8/0x33f091d001387326 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.979958:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607947.979978:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607947.979984:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008474eba8/0x33f091d001387326 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.979992:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607947.979997:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008474eba8/0x33f091d001387326 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.980005:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008474eba8/0x33f091d001387326 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.980027:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008474eba8/0x33f091d001387326 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.980034:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008474eba8/0x33f091d001387326 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.980062:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607947.980063:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607947.980065:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607947.980669:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607947.980675:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f087b6b/0x33f091d00138732d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.980683:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607947.980687:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607947.986467:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f087b6b/0x33f091d00138732d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.986497:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f087b6b/0x33f091d00138732d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.986511:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f087b6b/0x33f091d00138732d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.986519:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f087b6b/0x33f091d00138732d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.986567:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607947.986788:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607947.986796:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f087b6b/0x33f091d00138732d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.986814:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3a00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607947.986820:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f087b6b/0x33f091d00138732d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.986830:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f087b6b/0x33f091d00138732d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.986846:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f087b6b/0x33f091d00138732d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.986854:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f087b6b/0x33f091d00138732d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.986883:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607947.986885:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607947.986887:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607947.987485:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607947.987492:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019b58c5f/0x33f091d001387334 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.987505:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607947.987508:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607947.987513:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019b58c5f/0x33f091d001387334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.987523:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019b58c5f/0x33f091d001387334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.987532:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019b58c5f/0x33f091d001387334 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.987540:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019b58c5f/0x33f091d001387334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.987560:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607947.988797:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607947.988808:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019b58c5f/0x33f091d001387334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.988821:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2c00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607947.988825:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b58c5f/0x33f091d001387334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.988835:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019b58c5f/0x33f091d001387334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.988863:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019b58c5f/0x33f091d001387334 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.988871:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019b58c5f/0x33f091d001387334 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.988894:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607947.988896:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607947.988898:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607947.991247:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607947.991261:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068f8126c/0x33f091d00138733b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.991278:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607947.991289:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607947.991296:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068f8126c/0x33f091d00138733b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.991311:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068f8126c/0x33f091d00138733b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.991321:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068f8126c/0x33f091d00138733b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.991329:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068f8126c/0x33f091d00138733b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.991351:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607947.991365:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607947.991371:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068f8126c/0x33f091d00138733b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.991377:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2a00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607947.991382:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068f8126c/0x33f091d00138733b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.991390:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068f8126c/0x33f091d00138733b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.991408:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068f8126c/0x33f091d00138733b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.991461:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068f8126c/0x33f091d00138733b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.991479:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607947.991481:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607947.991482:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607947.994923:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607947.994935:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d001387342 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.994952:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607947.994957:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607947.994963:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d001387342 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.994978:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d001387342 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.994991:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d001387342 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995000:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d001387342 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995018:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789607947.995539:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607947.995552:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d001387349 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995562:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607947.995565:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607947.995569:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d001387349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995579:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d001387349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995588:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d001387349 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995595:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d001387349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995615:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789607947.995632:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607947.995638:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d001387342 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995646:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3e00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607947.995652:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d001387342 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995662:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d001387342 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995685:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d001387342 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995695:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e418349a/0x33f091d001387342 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995715:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607947.995718:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d001387349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995725:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a800 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607947.995728:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d001387349 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607947.995736:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d001387349 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607947.996857:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.004375:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d001387349 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.004388:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d001387349 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.004416:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.004418:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.004443:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607948.007273:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.007286:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000232417c2/0x33f091d001387350 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.007304:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.007309:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.007315:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000232417c2/0x33f091d001387350 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.007329:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000232417c2/0x33f091d001387350 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.007340:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000232417c2/0x33f091d001387350 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.007349:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000232417c2/0x33f091d001387350 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.007373:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789607948.007832:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607948.007840:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000232417c2/0x33f091d001387350 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.007850:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a600 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607948.007854:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000232417c2/0x33f091d001387350 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.007864:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000232417c2/0x33f091d001387350 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.007879:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000232417c2/0x33f091d001387350 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.007886:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000232417c2/0x33f091d001387350 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.007917:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607948.007919:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607948.007921:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789607948.008188:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1789607948.012343:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.012362:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387357 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.012382:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.012388:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.012396:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387357 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.012439:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387357 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.012453:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387357 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.012462:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387357 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.012484:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607948.012501:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607948.012508:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387357 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.012516:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607948.012521:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387357 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.013867:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387357 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.013889:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387357 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.013898:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387357 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.013932:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.013934:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.013937:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607948.014768:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.014778:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afc45bdc/0x33f091d00138735e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.014791:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.014800:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.014807:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afc45bdc/0x33f091d00138735e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.014820:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afc45bdc/0x33f091d00138735e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.014829:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afc45bdc/0x33f091d00138735e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.014836:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afc45bdc/0x33f091d00138735e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.014902:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789607948.015319:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.015326:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387365 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.015345:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.015348:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.015352:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.015362:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.015371:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387365 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.015379:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387365 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.018473:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789607948.018487:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afc45bdc/0x33f091d00138735e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.018501:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b600 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607948.018505:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afc45bdc/0x33f091d00138735e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.018517:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afc45bdc/0x33f091d00138735e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.018552:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afc45bdc/0x33f091d00138735e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.018560:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afc45bdc/0x33f091d00138735e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.018583:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789607948.018587:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.018593:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103aa00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607948.018605:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387365 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.018613:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387365 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.018622:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387365 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.018630:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607948.018631:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607948.018633:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.018812:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789607948.018820:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387365 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789607948.018866:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789607948.018896:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607948.019534:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.019543:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d00138736c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.019557:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.019562:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.019576:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d00138736c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.019589:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d00138736c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.019599:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d00138736c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.019606:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d00138736c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.019621:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789607948.020039:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.020045:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006147e4f5/0x33f091d001387373 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020053:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.020056:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.020060:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006147e4f5/0x33f091d001387373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020069:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006147e4f5/0x33f091d001387373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020077:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006147e4f5/0x33f091d001387373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020095:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006147e4f5/0x33f091d001387373 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020111:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789607948.020124:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607948.020130:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d00138736c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020137:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a800 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607948.020140:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d00138736c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020148:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d00138736c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020162:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d00138736c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020169:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e00d1b9b/0x33f091d00138736c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020184:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607948.020187:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006147e4f5/0x33f091d001387373 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020203:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607948.020206:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006147e4f5/0x33f091d001387373 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020214:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006147e4f5/0x33f091d001387373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020224:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006147e4f5/0x33f091d001387373 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020231:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006147e4f5/0x33f091d001387373 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020241:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.020242:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.020244:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607948.020660:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.020667:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da88eb4c/0x33f091d00138737a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020678:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.020681:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.020686:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da88eb4c/0x33f091d00138737a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020695:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da88eb4c/0x33f091d00138737a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020710:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da88eb4c/0x33f091d00138737a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020718:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da88eb4c/0x33f091d00138737a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020732:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607948.020751:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607948.020755:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da88eb4c/0x33f091d00138737a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020762:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103ac00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607948.020766:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da88eb4c/0x33f091d00138737a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020774:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da88eb4c/0x33f091d00138737a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020786:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da88eb4c/0x33f091d00138737a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020793:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da88eb4c/0x33f091d00138737a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.020807:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.020814:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.020816:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607948.021181:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.021187:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095f2cd30/0x33f091d001387381 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.021195:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.021198:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.021202:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095f2cd30/0x33f091d001387381 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.021211:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095f2cd30/0x33f091d001387381 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.021219:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095f2cd30/0x33f091d001387381 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.021226:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095f2cd30/0x33f091d001387381 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.021239:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789607948.021247:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607948.021251:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095f2cd30/0x33f091d001387381 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.021258:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103ba00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607948.021261:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095f2cd30/0x33f091d001387381 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.021279:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095f2cd30/0x33f091d001387381 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.021290:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095f2cd30/0x33f091d001387381 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.021297:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095f2cd30/0x33f091d001387381 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.021312:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.021314:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.021315:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607948.021709:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.021715:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeb0bef1/0x33f091d001387388 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.021723:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.021727:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.021730:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb0bef1/0x33f091d001387388 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.021949:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.022898:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeb0bef1/0x33f091d001387388 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.022926:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeb0bef1/0x33f091d001387388 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.022945:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeb0bef1/0x33f091d001387388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.022971:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789607948.023614:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.023621:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009caee55b/0x33f091d00138738f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.023633:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.023637:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.023644:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009caee55b/0x33f091d00138738f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.023656:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009caee55b/0x33f091d00138738f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.023665:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009caee55b/0x33f091d00138738f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.023672:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009caee55b/0x33f091d00138738f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.023828:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789607948.024240:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.024248:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e81f7a/0x33f091d001387396 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.024265:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.024268:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.024273:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072e81f7a/0x33f091d001387396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.024282:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072e81f7a/0x33f091d001387396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.024291:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072e81f7a/0x33f091d001387396 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.024298:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072e81f7a/0x33f091d001387396 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.024417:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789607948.024463:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607948.024470:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009caee55b/0x33f091d00138738f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.024479:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b800 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607948.024484:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009caee55b/0x33f091d00138738f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.024493:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009caee55b/0x33f091d00138738f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.024509:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009caee55b/0x33f091d00138738f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.024516:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009caee55b/0x33f091d00138738f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.024538:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607948.024541:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072e81f7a/0x33f091d001387396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.024548:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103be00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607948.024558:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e81f7a/0x33f091d001387396 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.024567:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072e81f7a/0x33f091d001387396 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.024577:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072e81f7a/0x33f091d001387396 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.024585:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607948.024587:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607948.024589:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607948.027875:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeb0bef1/0x33f091d001387388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.027890:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103ae00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607948.027895:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeb0bef1/0x33f091d001387388 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.027907:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeb0bef1/0x33f091d001387388 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.027929:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeb0bef1/0x33f091d001387388 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.027937:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeb0bef1/0x33f091d001387388 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607948.027972:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607948.027974:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607948.027976:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.030534:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789607948.030554:0:15114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072e81f7a/0x33f091d001387396 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789607948.031322:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.031330:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d00138739d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.031344:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.031348:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.031355:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d00138739d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.031379:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d00138739d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.031390:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d00138739d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.031399:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d00138739d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.031450:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789607948.031820:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789607948.031827:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d00138739d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607948.031836:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103aa00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:3.0:1789607948.031840:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d00138739d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607948.031849:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d00138739d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607948.031877:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d00138739d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607948.031898:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d00138739d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607948.031919:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607948.031921:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607948.031923:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607948.032164:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.032170:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d0013873a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.032179:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.032182:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.032187:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d0013873a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.032196:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d0013873a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.032204:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d0013873a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.032222:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d0013873a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.032243:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789607948.032655:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.032662:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b81b8ae/0x33f091d0013873ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.032670:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.032674:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.032678:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b81b8ae/0x33f091d0013873ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.032687:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b81b8ae/0x33f091d0013873ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.032823:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607948.032830:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d0013873a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.032839:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607948.032843:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d0013873a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.032852:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d0013873a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.032868:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d0013873a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.032876:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d0013873a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.032900:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607948.032902:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607948.032904:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.033819:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b81b8ae/0x33f091d0013873ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.033828:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b81b8ae/0x33f091d0013873ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.033854:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789607948.034447:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.034455:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013873b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.034472:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.034477:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.034483:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013873b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.034496:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013873b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.034504:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013873b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.034512:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013873b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.034521:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789607948.034822:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789607948.034830:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b81b8ae/0x33f091d0013873ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.034839:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b000 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607948.034844:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b81b8ae/0x33f091d0013873ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.034853:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b81b8ae/0x33f091d0013873ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.034871:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b81b8ae/0x33f091d0013873ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.034878:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b81b8ae/0x33f091d0013873ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.034899:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607948.034902:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013873b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.034908:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103bc00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607948.034919:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013873b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.034927:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013873b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.034937:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013873b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.034944:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d23e311/0x33f091d0013873b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607948.034957:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607948.034959:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607948.034960:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789607948.035821:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789607948.037624:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.037636:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013873b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.037654:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.037658:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.037665:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013873b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.042253:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013873b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.042297:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013873b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.042305:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013873b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.042333:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789607948.043082:0:15114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789607948.043089:0:15114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d0013873c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043104:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=481s v=(0 0) 00010000:00010000:2.0:1789607948.043108:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607948.043114:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d0013873c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043126:0:15114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d0013873c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043134:0:15114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d0013873c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043141:0:15114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d0013873c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043171:0:15114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789607948.043186:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607948.043192:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013873b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043199:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607948.043203:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013873b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043212:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013873b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043228:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013873b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043234:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e72eddf/0x33f091d0013873b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043251:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607948.043254:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d0013873c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043260:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:2.0:1789607948.043263:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d0013873c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043280:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d0013873c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043289:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d0013873c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043295:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa636189/0x33f091d0013873c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607948.043306:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.043308:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607948.043309:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789607948.043499:0:15114:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1789607948.043592:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14456:x1876539541133056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 122255us (122380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607948.043602:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789607948.043665:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14456:1876539541133056:0@lo:5:osp-pre-1-0.0 00010000:00010000:1.0:1789607948.043824:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789607948.043880:0:14456:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789607948.043936:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14456:1876539541133184:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789607948.043975:0:14456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607948.044022:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a200cebcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607948.044036:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541133184 00000100:00100000:2.0:1789607948.044041:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541133184 00000100:00100000:2.0:1789607948.044077:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607948.044085:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14456:x1876539541133184:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789607948.044125:0:15117:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789607948.055245:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14456:x1876539541133184:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11151us (11260us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789607948.055261:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789607948.055382:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14456:1876539541133184:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789607948.055399:0:14456:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1789607948.365563:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607949.388440:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607949.971083:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541133312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789607949.971159:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607949.971335:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541133312 00000100:00100000:3.0:1789607949.971344:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541133312 00000100:00100000:3.0:1789607949.971396:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789607949.971409:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541133312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607949.971481:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607949.971525:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541133312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607949.971533:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789607949.971554:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607949.971591:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541133312:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1789607950.044859:0:16191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg203-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789607950.413644:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607951.444894:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789607951.890792:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789607952.408997:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607952.411228:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520163072 00000100:00100000:0.0:1789607952.411245:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520163072 00000100:00100000:0.0:1789607952.411312:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:0.0:1789607952.411322:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2372:x1876539520163072:12345-192.168.202.3@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789607952.411354:0:14424:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from d77ce731-97c5-433c-91e3-ef21b84dcc39@192.168.202.3@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:0.0:1789607952.411401:0:14424:0:(genops.c:1384:class_connect()) connect: client d77ce731-97c5-433c-91e3-ef21b84dcc39, cookie 0x33f091d0013873c7 00000100:00080000:0.0:1789607952.411618:0:14424:0:(import.c:65:import_set_state_nolock()) ffff99a1ee440000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607952.411733:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5001c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+5:2372:x1876539520163072:12345-192.168.202.3@tcp:250:mount.lustre.0 Request processed in 410us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607952.411747:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 75 00000100:00100000:1.0:1789607952.421086:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607952.421191:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520163200 00000100:00100000:3.0:1789607952.421204:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520163200 00000100:00100000:3.0:1789607952.421282:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:3.0:1789607952.421295:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+5:13771:x1876539520163200:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789607952.421317:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607952.421342:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558f000/0x33f091d0013873ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b993e expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607952.421416:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558f000/0x33f091d0013873ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b993e expref: 6 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607952.421469:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558f000/0x33f091d0013873ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b993e expref: 6 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607952.421480:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558f000, rc 0) 00000100:00100000:3.0:1789607952.421562:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5001850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+6:13771:x1876539520163200:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 269us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607952.421570:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 76 00000100:00100000:2.0:1789607952.426096:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607952.426319:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520163328 00000100:00100000:1.0:1789607952.426334:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520163328 00000100:00100000:1.0:1789607952.426485:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:1.0:1789607952.426499:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+6:13771:x1876539520163328:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789607952.427407:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5002450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+6:13771:x1876539520163328:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 905us (1321us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789607952.427420:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 77 00000100:00100000:1.0:1789607952.432355:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607952.432567:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520163456 00000100:00100000:0.0:1789607952.432581:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520163456 00000100:00100000:0.0:1789607952.432696:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:0.0:1789607952.432719:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+6:13771:x1876539520163456:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789607952.432741:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607952.432767:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ee2acc00/0x33f091d0013873d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9945 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607952.432803:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ee2acc00/0x33f091d0013873d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9945 expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607952.432814:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ee2acc00/0x33f091d0013873d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9945 expref: 7 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607952.432824:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2acc00, rc 0) 00000100:00100000:0.0:1789607952.432901:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5003c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+7:13771:x1876539520163456:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 185us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607952.432909:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 78 00000100:00100000:1.0:1789607952.439265:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607952.439382:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520163584 00000100:00100000:0.0:1789607952.439405:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520163584 00000100:00100000:0.0:1789607952.439496:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:0.0:1789607952.439510:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+7:13771:x1876539520163584:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789607952.440362:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5002050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+8:13771:x1876539520163584:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 847us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607952.440374:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 79 00000100:00100000:2.0:1789607952.453859:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607952.454008:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520163712 00000100:00100000:3.0:1789607952.454022:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520163712 00000100:00100000:3.0:1789607952.454110:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 80 00000100:00100000:3.0:1789607952.454123:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+8:13771:x1876539520163712:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789607952.454503:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+8:13771:x1876539520163712:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 381us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607952.454512:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 80 00010000:00010000:2.0:1789607952.459785:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607952.469953:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607952.470919:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520163840 00000100:00100000:2.0:1789607952.470936:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520163840 00000100:00100000:2.0:1789607952.471439:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:2.0:1789607952.471455:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+8:13790:x1876539520163840:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607952.471863:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5000450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+8:13790:x1876539520163840:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 411us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607952.471872:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 81 00000100:00100000:1.0:1789607952.514305:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607952.514413:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520163968 00000100:00100000:0.0:1789607952.514457:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520163968 00000100:00100000:0.0:1789607952.514521:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:0.0:1789607952.514532:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+8:13790:x1876539520163968:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607952.515011:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5003850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+8:13790:x1876539520163968:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 480us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607952.515021:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 82 00000100:00100000:0.0:1789607952.525307:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607952.526521:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520164096 00000100:00100000:2.0:1789607952.526538:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520164096 00000100:00100000:2.0:1789607952.526619:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 83 00000100:00100000:2.0:1789607952.526631:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+8:13771:x1876539520164096:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789607952.526663:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607952.526688:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103a000/0x33f091d0013873dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b996f expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607952.526756:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103a000/0x33f091d0013873dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b996f expref: 9 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607952.526768:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103a000/0x33f091d0013873dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b996f expref: 9 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607952.526779:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a000, rc 0) 00000100:00100000:2.0:1789607952.526863:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5000850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+9:13771:x1876539520164096:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 234us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607952.526870:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 83 00000100:00100000:1.0:1789607952.529932:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607952.530064:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520164224 00000100:00100000:0.0:1789607952.530077:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520164224 00000100:00100000:0.0:1789607952.530144:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:0.0:1789607952.530157:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f5001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+9:13771:x1876539520164224:12345-192.168.202.3@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789607952.530194:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789607952.530226:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789607952.530231:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789607952.530234:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789607952.530237:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789607952.532742:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f5001450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+9:13771:x1876539520164224:12345-192.168.202.3@tcp:256:mount.lustre.0 Request processed in 2573us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607952.532767:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 84 00000100:00100000:1.0:1789607952.541280:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607952.541378:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520164352 00000100:00100000:3.0:1789607952.541392:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520164352 00000100:00100000:3.0:1789607952.541505:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:3.0:1789607952.541518:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+9:13771:x1876539520164352:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789607952.541543:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607952.541567:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558ee00/0x33f091d0013873e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9976 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607952.541607:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558ee00/0x33f091d0013873e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9976 expref: 10 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607952.541642:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558ee00/0x33f091d0013873e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9976 expref: 10 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607952.541653:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558ee00, rc 0) 00000100:00100000:3.0:1789607952.541743:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+10:13771:x1876539520164352:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 227us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607952.541751:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 85 00000100:00100000:1.0:1789607952.545769:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607952.546146:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520164480 00000100:00100000:0.0:1789607952.546160:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520164480 00000100:00100000:0.0:1789607952.546234:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:0.0:1789607952.546247:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+10:13771:x1876539520164480:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789607952.546987:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+10:13771:x1876539520164480:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 727us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607952.547011:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 86 00000100:00100000:1.0:1789607952.549788:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607952.549917:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520164608 00000100:00100000:2.0:1789607952.549930:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520164608 00000100:00100000:2.0:1789607952.550234:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 87 00000100:00100000:2.0:1789607952.550248:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+10:13771:x1876539520164608:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789607952.550772:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+10:13771:x1876539520164608:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 525us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607952.550783:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 87 00000100:00100000:1.0:1789607952.558936:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607952.559496:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520164736 00000100:00100000:0.0:1789607952.559512:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520164736 00000100:00100000:0.0:1789607952.559588:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 88 00000100:00100000:0.0:1789607952.559601:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+10:13795:x1876539520164736:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607952.559970:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+10:13795:x1876539520164736:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 369us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607952.559978:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 88 00000100:00100000:0.0:1789607952.568907:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607952.569016:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520164864 00000100:00100000:2.0:1789607952.569031:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520164864 00000100:00100000:2.0:1789607952.569108:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 89 00000100:00100000:2.0:1789607952.569122:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+10:13795:x1876539520164864:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607952.569503:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+10:13795:x1876539520164864:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 383us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607952.569512:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 89 00000100:00100000:1.0:1789607952.583369:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607952.583882:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520164992 00000100:00100000:0.0:1789607952.583897:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520164992 00000100:00100000:0.0:1789607952.583969:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:0.0:1789607952.583979:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2372:x1876539520164992:12345-192.168.202.3@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789607952.584022:0:14432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 3e4d0e76-8b10-4097-8a3e-1656392a0727@192.168.202.3@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:0.0:1789607952.584109:0:14432:0:(genops.c:1384:class_connect()) connect: client 3e4d0e76-8b10-4097-8a3e-1656392a0727, cookie 0x33f091d0013873ea 00000004:00100000:0.0:1789607952.584160:0:14432:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1789607952.584168:0:14432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1789607952.651352:0:14432:0:(import.c:65:import_set_state_nolock()) ffff99a201b30000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789607952.651499:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:2372:x1876539520164992:12345-192.168.202.3@tcp:38:mount.lustre.0 Request processed in 67517us (68142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607952.651513:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1789607952.655008:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607952.655152:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520165248 00000100:00100000:2.0:1789607952.655184:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520165248 00000100:00100000:2.0:1789607952.655298:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:2.0:1789607952.655311:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:13771:x1876539520165248:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789607952.655372:0:14433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1789607952.655556:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607952.655896:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:13771:x1876539520165248:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 586us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607952.655905:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:3.0:1789607952.656826:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607952.656906:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520165120 00000100:00100000:2.0:1789607952.656916:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520165120 00000100:00100000:2.0:1789607952.656985:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:2.0:1789607952.656995:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:0:x1876539520165120:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789607952.657027:0:14432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789607952.657691:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:0:x1876539520165120:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 692us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607952.657711:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:1.0:1789607952.659850:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607952.659994:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520165376 00000100:00100000:2.0:1789607952.660008:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520165376 00000100:00100000:2.0:1789607952.660161:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:2.0:1789607952.660173:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:13771:x1876539520165376:12345-192.168.202.3@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789607952.660336:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:13771:x1876539520165376:12345-192.168.202.3@tcp:40:mount.lustre.0 Request processed in 165us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607952.660344:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:1.0:1789607952.664336:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607952.664390:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607952.664462:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520165504 00000100:00100000:2.0:1789607952.664476:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520165504 00000100:00100000:1.0:1789607952.664479:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607952.664526:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520165632 00000100:00100000:2.0:1789607952.664529:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520165632 00000100:00100000:1.0:1789607952.664538:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:1.0:1789607952.664549:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2372:x1876539520165504:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789607952.664598:0:15114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 3e4d0e76-8b10-4097-8a3e-1656392a0727@192.168.202.3@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:1.0:1789607952.664654:0:15114:0:(genops.c:1384:class_connect()) connect: client 3e4d0e76-8b10-4097-8a3e-1656392a0727, cookie 0x33f091d0013873f1 00002000:00100000:1.0:1789607952.664672:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3e4d0e76-8b10-4097-8a3e-1656392a0727/ffff99a1e8f3c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1789607952.664684:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520165760 00000100:00100000:0.0:1789607952.664689:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520165760 00002000:00100000:1.0:1789607952.664718:0:15114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789607952.664788:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:0.0:1789607952.664797:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:13771:x1876539520165760:12345-192.168.202.3@tcp:33:mount.lustre.0 00002000:00080000:0.0:1789607952.665624:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789607952.665668:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99a1ee444000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607952.665773:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:2372:x1876539520165504:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 1223us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607952.665791:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:0.0:1789607952.665824:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:0.0:1789607952.665830:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2372:x1876539520165632:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789607952.665855:0:15114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 3e4d0e76-8b10-4097-8a3e-1656392a0727@192.168.202.3@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:0.0:1789607952.665893:0:15114:0:(genops.c:1384:class_connect()) connect: client 3e4d0e76-8b10-4097-8a3e-1656392a0727, cookie 0x33f091d0013873f8 00002000:00100000:0.0:1789607952.665904:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3e4d0e76-8b10-4097-8a3e-1656392a0727/ffff99a1c8e0b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789607952.665925:0:15114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789607952.666083:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789607952.666101:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99a1d06a4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607952.666143:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201878700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:2372:x1876539520165632:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 312us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607952.666150:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000004:00080000:3.0:1789607952.668330:0:14434:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3441us 00000004:00200000:0.0:1789607952.702504:0:14434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789607952.702710:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201878a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:13771:x1876539520165760:12345-192.168.202.3@tcp:33:mount.lustre.0 Request processed in 37894us (38369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607952.702725:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:1.0:1789607952.890382:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607952.890991:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520165888 00000100:00100000:2.0:1789607952.891007:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520165888 00000100:00100000:2.0:1789607952.891152:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:2.0:1789607952.891165:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:13816:x1876539520165888:12345-192.168.202.3@tcp:101:mkdir.0 00010000:00010000:2.0:1789607952.891195:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607952.891242:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b200/0x33f091d0013873ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b99a0 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607952.891332:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387406 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607952.891349:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387406 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607952.891368:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387406 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607952.891414:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607952.891419:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607952.891788:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387406 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607952.891819:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b200/0x33f091d0013873ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99a0 expref: 8 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607952.891840:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387406 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99a0 expref: 7 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607952.891850:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c5961600) 00010000:00010000:2.0:1789607952.891853:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607952.891874:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103ac00, rc 0) 00000100:00100000:2.0:1789607952.892012:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201878380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:13816:x1876539520165888:12345-192.168.202.3@tcp:101:mkdir.0 Request processed in 849us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607952.892020:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:3.0:1789607953.039933:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541133824:0@lo:400:kworker.0 00000100:00100000:0.0:1789607953.039938:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3312:1876539541133440:0@lo:400:kworker.0 00000100:00100000:2.0:1789607953.044207:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541133696:0@lo:400:kworker.0 00000100:00100000:3.0:1789607953.049583:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607953.049658:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541133824 00000100:00100000:3.0:1789607953.049670:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541133824 00000100:00100000:3.0:1789607953.049780:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607953.049794:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541133824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607953.049870:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541133824:12345-0@lo:400:kworker.0 Request processed in 81us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607953.049878:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607953.049960:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541133824:0@lo:400:kworker.0 00000100:00100000:3.0:1789607953.050055:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541133568:0@lo:400:kworker.0 00000100:00100000:3.0:1789607953.050099:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607953.050127:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541134080:0@lo:400:kworker.0 00000100:00100000:3.0:1789607953.050149:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607953.050169:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789607953.050175:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541134208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607953.050199:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607953.050233:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541134208 00000100:00100000:3.0:1789607953.050237:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541134208 00000100:00100000:3.0:1789607953.050279:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789607953.050286:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876539541134208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607953.050307:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607953.050346:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876539541134208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607953.050352:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789607953.050370:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607953.050416:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541134208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607953.050490:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541133568 00000100:00100000:3.0:1789607953.050495:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541133568 00000100:00100000:3.0:1789607953.050527:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789607953.050534:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541133568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607953.050585:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541133568:12345-0@lo:400:kworker.0 Request processed in 51us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607953.050593:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789607953.050607:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607953.050626:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541133568:0@lo:400:kworker.0 00000100:00100000:3.0:1789607953.050661:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541134080 00000100:00100000:3.0:1789607953.050665:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541134080 00000100:00100000:3.0:1789607953.050710:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789607953.050718:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541134080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607953.050755:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541134080:12345-0@lo:400:kworker.0 Request processed in 39us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607953.050761:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1789607953.050775:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607953.050795:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541134080:0@lo:400:kworker.0 00000100:00100000:0.0:1789607953.052094:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607953.052168:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541133440 00000100:00100000:0.0:1789607953.052177:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541133440 00000100:00100000:0.0:1789607953.052233:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789607953.052243:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:3312:x1876539541133440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607953.052302:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:3312:x1876539541133440:12345-0@lo:400:kworker.0 Request processed in 59us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607953.052321:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789607953.052403:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3312:1876539541133440:0@lo:400:kworker.0 00000100:00100000:0.0:1789607953.052448:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541133952:0@lo:400:kworker.0 00000100:00100000:0.0:1789607953.052485:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607953.052510:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541133952 00000100:00100000:0.0:1789607953.052514:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541133952 00000100:00100000:0.0:1789607953.052554:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789607953.052560:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541133952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607953.052595:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541133952:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607953.052601:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789607953.052618:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607953.052655:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541133952:0@lo:400:kworker.0 00000100:00100000:3.0:1789607953.068675:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607953.068799:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541133696 00000100:00100000:3.0:1789607953.068812:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541133696 00000100:00100000:3.0:1789607953.068881:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607953.068894:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876539541133696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789607953.068987:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1876539541133696:12345-0@lo:400:kworker.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607953.068995:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789607953.072130:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2700e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541133696:0@lo:400:kworker.0 00000001:00100000:3.0:1789607953.129056:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3e4d0e76-8b10-4097-8a3e-1656392a0727 00000001:00080000:3.0:1789607953.129078:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1789607953.483684:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607954.507770:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607955.085881:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541134336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607955.085975:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607955.086066:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541134336 00000100:00100000:3.0:1789607955.086075:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541134336 00000100:00100000:3.0:1789607955.086141:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789607955.086151:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541134336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789607955.086195:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607955.086242:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541134336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607955.086249:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789607955.086274:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607955.086312:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541134336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607955.098594:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607955.098641:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520166016 00000100:00100000:3.0:1789607955.098652:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520166016 00000100:00100000:3.0:1789607955.098723:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:3.0:1789607955.098736:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:13869:x1876539520166016:12345-192.168.202.3@tcp:41:lfs.0 00000004:00000024:3.0:1789607955.098789:0:14433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789607955.098876:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:13869:x1876539520166016:12345-192.168.202.3@tcp:41:lfs.0 Request processed in 143us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607955.098884:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00080000:3.0:1789607955.098906:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607955.108236:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607955.108316:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520166144 00000100:00100000:3.0:1789607955.108328:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520166144 00000100:00100000:3.0:1789607955.108400:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1789607955.108410:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:13869:x1876539520166144:12345-192.168.202.3@tcp:13:lfs.0 00002000:00000024:3.0:1789607955.108459:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607955.108541:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:13869:x1876539520166144:12345-192.168.202.3@tcp:13:lfs.0 Request processed in 131us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607955.108549:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00080000:0.0:1789607955.112711:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789607955.113324:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607955.113408:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520166272 00000100:00100000:3.0:1789607955.113446:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520166272 00000100:00100000:3.0:1789607955.113525:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:3.0:1789607955.113539:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:13869:x1876539520166272:12345-192.168.202.3@tcp:13:lfs.0 00002000:00000024:3.0:1789607955.113580:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607955.113671:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:13869:x1876539520166272:12345-192.168.202.3@tcp:13:lfs.0 Request processed in 135us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607955.113687:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00080000:0.0:1789607955.113935:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1789607955.160408:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3e4d0e76-8b10-4097-8a3e-1656392a0727 00000100:00100000:3.0:1789607955.407916:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607955.408110:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520166400 00000100:00100000:0.0:1789607955.408120:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520166400 00000100:00100000:0.0:1789607955.408180:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 91 00000100:00100000:0.0:1789607955.408190:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+10:13903:x1876539520166400:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789607955.408207:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607955.408226:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ee2ac200/0x33f091d00138740d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b99a7 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607955.408288:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ee2ac200/0x33f091d00138740d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99a7 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607955.408302:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ee2ac200/0x33f091d00138740d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99a7 expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607955.408311:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ac200, rc 0) 00000100:00100000:0.0:1789607955.408508:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+11:13903:x1876539520166400:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 318us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607955.408515:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 91 00000100:00100000:3.0:1789607955.415125:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607955.415256:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520166528 00000100:00100000:2.0:1789607955.415267:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520166528 00000100:00100000:2.0:1789607955.415317:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 92 00000100:00100000:2.0:1789607955.415326:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+11:13903:x1876539520166528:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789607955.415874:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+11:13903:x1876539520166528:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 546us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607955.415882:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 92 00000100:00100000:2.0:1789607955.421788:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607955.422052:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520166656 00000100:00100000:0.0:1789607955.422064:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520166656 00000100:00100000:0.0:1789607955.422166:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 93 00000100:00100000:0.0:1789607955.422177:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+11:13903:x1876539520166656:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789607955.422561:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+11:13903:x1876539520166656:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 385us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607955.422570:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 93 00000100:00100000:0.0:1789607955.428086:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607955.428735:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520166784 00000100:00100000:2.0:1789607955.428747:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520166784 00000100:00100000:2.0:1789607955.428805:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 94 00000100:00100000:2.0:1789607955.428816:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+11:13908:x1876539520166784:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607955.429198:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+11:13908:x1876539520166784:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 383us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607955.429207:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 94 00000100:00100000:1.0:1789607955.465148:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607955.465274:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520166912 00000100:00100000:0.0:1789607955.465285:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520166912 00000100:00100000:0.0:1789607955.465345:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 95 00000100:00100000:0.0:1789607955.465365:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+11:13908:x1876539520166912:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789607955.465694:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+11:13908:x1876539520166912:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 339us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607955.465704:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 95 00000100:00100000:0.0:1789607955.477854:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607955.478261:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520167040 00000100:00100000:3.0:1789607955.478272:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520167040 00000100:00100000:3.0:1789607955.478333:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 96 00000100:00100000:3.0:1789607955.478345:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+11:13903:x1876539520167040:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789607955.478374:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607955.478393:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1f558fc00/0x33f091d001387414 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b99d1 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607955.478461:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1f558fc00/0x33f091d001387414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99d1 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607955.478475:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1f558fc00/0x33f091d001387414 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99d1 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607955.478484:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1f558fc00, rc 0) 00000100:00100000:3.0:1789607955.478537:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+12:13903:x1876539520167040:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 195us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607955.478545:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 96 00000100:00100000:3.0:1789607955.487595:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607955.487863:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520167168 00000100:00100000:2.0:1789607955.487874:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520167168 00000100:00100000:2.0:1789607955.487935:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 97 00000100:00100000:2.0:1789607955.487946:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+12:13903:x1876539520167168:12345-192.168.202.3@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789607955.487974:0:14426:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789607955.488006:0:14426:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789607955.488010:0:14426:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789607955.488013:0:14426:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789607955.488015:0:14426:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789607955.494347:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+12:13903:x1876539520167168:12345-192.168.202.3@tcp:256:mount.lustre.0 Request processed in 6391us (6750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607955.494371:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 97 00000100:00100000:0.0:1789607955.500078:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607955.500380:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520167296 00000100:00100000:1.0:1789607955.500390:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520167296 00000100:00100000:1.0:1789607955.500482:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:1.0:1789607955.500493:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+12:13903:x1876539520167296:12345-192.168.202.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789607955.500511:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607955.500531:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1ff4efe00/0x33f091d00138741b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b99d8 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607955.500561:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ff4efe00/0x33f091d00138741b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99d8 expref: 13 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607955.500571:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1ff4efe00/0x33f091d00138741b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99d8 expref: 13 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607955.500580:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4efe00, rc 0) 00000100:00100000:1.0:1789607955.500639:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13903:x1876539520167296:12345-192.168.202.3@tcp:101:mount.lustre.0 Request processed in 147us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607955.500660:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 98 00000100:00100000:3.0:1789607955.507948:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607955.508215:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520167424 00000100:00100000:2.0:1789607955.508227:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520167424 00000100:00100000:2.0:1789607955.508761:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00100000:2.0:1789607955.508771:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13903:x1876539520167424:12345-192.168.202.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789607955.510084:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13903:x1876539520167424:12345-192.168.202.3@tcp:501:mount.lustre.0 Request processed in 1306us (2139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607955.510096:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 99 00000100:00100000:3.0:1789607955.518898:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607955.522505:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520167552 00000100:00100000:1.0:1789607955.522521:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520167552 00000100:00100000:1.0:1789607955.522749:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 100 00000100:00100000:1.0:1789607955.522761:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13903:x1876539520167552:12345-192.168.202.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789607955.523071:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13903:x1876539520167552:12345-192.168.202.3@tcp:503:mount.lustre.0 Request processed in 311us (4182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607955.523079:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 100 00010000:00010000:1.0:1789607955.531723:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607955.532105:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607955.533918:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520167680 00000100:00100000:2.0:1789607955.533932:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520167680 00000100:00100000:2.0:1789607955.534010:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 101 00000100:00100000:2.0:1789607955.534023:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff57b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13911:x1876539520167680:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789607955.534472:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff57b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13911:x1876539520167680:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 450us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607955.534481:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 101 00000100:00100000:0.0:1789607955.546941:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607955.547200:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520167808 00000100:00100000:1.0:1789607955.547212:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520167808 00000100:00100000:1.0:1789607955.547288:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 102 00000100:00100000:1.0:1789607955.547299:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13911:x1876539520167808:12345-192.168.202.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789607955.547993:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13911:x1876539520167808:12345-192.168.202.3@tcp:502:llog_process_th.0 Request processed in 693us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607955.548003:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 102 00000100:00100000:1.0:1789607955.561542:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607955.561936:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520167936 00000100:00100000:0.0:1789607955.561947:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520167936 00000100:00100000:0.0:1789607955.562000:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:0.0:1789607955.562009:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2372:x1876539520167936:12345-192.168.202.3@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789607955.562042:0:14432:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e6e80d5c-081b-40da-8a54-f28641401897@192.168.202.3@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:0.0:1789607955.562080:0:14432:0:(genops.c:1384:class_connect()) connect: client e6e80d5c-081b-40da-8a54-f28641401897, cookie 0x33f091d001387422 00000004:00100000:0.0:1789607955.562110:0:14432:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789607955.562234:0:14432:0:(import.c:65:import_set_state_nolock()) ffff99a201699800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607955.562478:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201879c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6e80d5c-081b-40da-8a54-f28641401897+6:2372:x1876539520167936:12345-192.168.202.3@tcp:38:mount.lustre.0 Request processed in 467us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607955.562486:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:0.0:1789607955.565004:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607955.565056:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607955.565142:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520168576 00000100:00100000:1.0:1789607955.565151:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520168576 00000100:00100000:1.0:1789607955.565211:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:1.0:1789607955.565220:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2373:x1876539520168576:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607955.565310:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2373:x1876539520168576:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 91us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607955.565318:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:3.0:1789607955.565924:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520168064 00000100:00100000:3.0:1789607955.565931:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520168064 00000100:00100000:3.0:1789607955.565975:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:3.0:1789607955.565983:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:2373:x1876539520168064:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607955.566022:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:2373:x1876539520168064:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 40us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607955.566028:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:2.0:1789607955.566116:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607955.566305:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520168448 00000100:00100000:0.0:1789607955.566310:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520168448 00000100:00100000:0.0:1789607955.566353:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:0.0:1789607955.566360:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2373:x1876539520168448:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607955.566393:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2373:x1876539520168448:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 34us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607955.566400:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:2.0:1789607955.571900:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607955.572366:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520168192 00000100:00100000:0.0:1789607955.572378:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520168192 00000100:00100000:0.0:1789607955.572545:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1789607955.572570:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6e80d5c-081b-40da-8a54-f28641401897+6:0:x1876539520168192:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789607955.572633:0:14432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789607955.572721:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6e80d5c-081b-40da-8a54-f28641401897+6:0:x1876539520168192:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 152us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607955.572728:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00080000:3.0:1789607955.578850:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789607955.582818:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607955.582927:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520168320 00000100:00100000:1.0:1789607955.582952:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520168320 00000100:00100000:1.0:1789607955.583023:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:1.0:1789607955.583035:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6e80d5c-081b-40da-8a54-f28641401897+6:13903:x1876539520168320:12345-192.168.202.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789607955.583069:0:14433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789607955.583163:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6e80d5c-081b-40da-8a54-f28641401897+6:13903:x1876539520168320:12345-192.168.202.3@tcp:41:mount.lustre.0 Request processed in 130us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607955.583170:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:2.0:1789607955.598345:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607955.598453:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520168704 00000100:00100000:1.0:1789607955.598467:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520168704 00000100:00100000:1.0:1789607955.598531:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1789607955.598542:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6e80d5c-081b-40da-8a54-f28641401897+6:13903:x1876539520168704:12345-192.168.202.3@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789607955.598657:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6e80d5c-081b-40da-8a54-f28641401897+6:13903:x1876539520168704:12345-192.168.202.3@tcp:40:mount.lustre.0 Request processed in 117us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607955.598665:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:3.0:1789607955.614965:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607955.615033:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607955.615147:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520168960 00000100:00100000:0.0:1789607955.615147:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520168832 00000100:00100000:2.0:1789607955.615156:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520168960 00000100:00100000:0.0:1789607955.615156:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520168832 00000100:00100000:0.0:1789607955.615205:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1789607955.615262:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2372:x1876539520168960:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789607955.615307:0:15114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e6e80d5c-081b-40da-8a54-f28641401897@192.168.202.3@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:0.0:1789607955.615340:0:15114:0:(genops.c:1384:class_connect()) connect: client e6e80d5c-081b-40da-8a54-f28641401897, cookie 0x33f091d001387429 00002000:00100000:0.0:1789607955.615351:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e6e80d5c-081b-40da-8a54-f28641401897/ffff99a20169c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789607955.615373:0:15114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789607955.615677:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789607955.615709:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99a20169d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607955.615781:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6e80d5c-081b-40da-8a54-f28641401897+6:2372:x1876539520168960:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 568us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607955.620970:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607955.621156:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520169088 00000100:00100000:3.0:1789607955.621166:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520169088 00000100:00100000:3.0:1789607955.621222:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:3.0:1789607955.621232:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6e80d5c-081b-40da-8a54-f28641401897+6:13903:x1876539520169088:12345-192.168.202.3@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789607955.621316:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789607955.621409:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6e80d5c-081b-40da-8a54-f28641401897+6:13903:x1876539520169088:12345-192.168.202.3@tcp:33:mount.lustre.0 Request processed in 178us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607955.621417:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:0.0:1789607955.624001:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1789607955.624039:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:0.0:1789607955.624046:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2372:x1876539520168832:12345-192.168.202.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789607955.624078:0:15114:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e6e80d5c-081b-40da-8a54-f28641401897@192.168.202.3@tcp t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:0.0:1789607955.624112:0:15114:0:(genops.c:1384:class_connect()) connect: client e6e80d5c-081b-40da-8a54-f28641401897, cookie 0x33f091d001387430 00002000:00100000:0.0:1789607955.624124:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e6e80d5c-081b-40da-8a54-f28641401897/ffff99a201699000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789607955.624146:0:15114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789607955.625643:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789607955.625694:0:15114:0:(import.c:65:import_set_state_nolock()) ffff99a20169e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789607955.625762:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6e80d5c-081b-40da-8a54-f28641401897+6:2372:x1876539520168832:12345-192.168.202.3@tcp:8:mount.lustre.0 Request processed in 1715us (10806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607955.625772:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:0.0:1789607955.915922:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607955.916008:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520169216 00000100:00100000:3.0:1789607955.916018:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520169216 00000100:00100000:3.0:1789607955.916081:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1789607955.916093:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6e80d5c-081b-40da-8a54-f28641401897+6:13932:x1876539520169216:12345-192.168.202.3@tcp:101:mkdir.0 00010000:00010000:3.0:1789607955.916115:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607955.916140:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001387437 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a02 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607955.916221:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138743e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607955.916236:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138743e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607955.916248:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138743e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607955.916294:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789607955.916298:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607955.916319:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138743e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607955.916344:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0031000/0x33f091d001387437 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a02 expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607955.916375:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138743e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a02 expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607955.916384:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c5961600) 00010000:00010000:3.0:1789607955.916387:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607955.916390:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c0030a00, rc 0) 00000100:00100000:3.0:1789607955.916505:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6e80d5c-081b-40da-8a54-f28641401897+7:13932:x1876539520169216:12345-192.168.202.3@tcp:101:mkdir.0 Request processed in 415us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607955.916512:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00010000:00010000:2.0:1789607956.555685:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607957.582479:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789607957.710033:0:5869:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e6e80d5c-081b-40da-8a54-f28641401897 00000001:00100000:2.0:1789607957.710054:0:5869:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3e4d0e76-8b10-4097-8a3e-1656392a0727 00000100:00100000:3.0:1789607958.158857:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541134848:0@lo:400:kworker.0 00000100:00100000:0.0:1789607958.158857:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541134464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789607958.158934:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607958.159137:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541134720:0@lo:400:kworker.0 00000100:00100000:0.0:1789607958.159361:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541134976:0@lo:400:kworker.0 00000100:00100000:2.0:1789607958.159629:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541134464 00000100:00100000:2.0:1789607958.159641:0:15118:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541134464 00000100:00100000:2.0:1789607958.159732:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789607958.159742:0:15118:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541134464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607958.159774:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789607958.160061:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607958.160093:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541135232:0@lo:400:kworker.0 00000100:00100000:1.0:1789607958.160124:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607958.160148:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789607958.160155:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3310:1876539541134592:0@lo:400:kworker.0 00000100:00100000:1.0:1789607958.160182:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607958.160207:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876539541135104:0@lo:400:kworker.0 00000100:00100000:1.0:1789607958.160253:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607958.162885:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541135232 00000100:00100000:1.0:1789607958.162911:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541135232 00000100:00100000:1.0:1789607958.162960:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541135104 00000100:00100000:1.0:1789607958.162964:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541135104 00000100:00100000:1.0:1789607958.162987:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789607958.162996:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541135232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607958.163082:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541135232:12345-0@lo:400:kworker.0 Request processed in 87us (2956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607958.163090:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789607958.163107:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607958.163112:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876539541135104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607958.163140:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1876539541135104:12345-0@lo:400:kworker.0 Request processed in 28us (2887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607958.163147:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789607958.163166:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541134592 00000100:00100000:1.0:1789607958.163170:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541134592 00000100:00100000:1.0:1789607958.163191:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789607958.163197:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:3310:x1876539541134592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607958.163229:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:3310:x1876539541134592:12345-0@lo:400:kworker.0 Request processed in 31us (3045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607958.163235:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789607958.163266:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541134720 00000100:00100000:1.0:1789607958.163269:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541134720 00000100:00100000:1.0:1789607958.163294:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607958.163300:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541134720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789607958.163331:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541134720:12345-0@lo:400:kworker.0 Request processed in 32us (3271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607958.163355:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607958.163401:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3310:1876539541134592:0@lo:400:kworker.0 00000100:00100000:1.0:1789607958.163416:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1876539541135104:0@lo:400:kworker.0 00000100:00100000:1.0:1789607958.163453:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541134720:0@lo:400:kworker.0 00000100:00100000:1.0:1789607958.163464:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541135232:0@lo:400:kworker.0 00000100:00100000:0.0:1789607958.167373:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607958.167461:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541134976 00000100:00100000:0.0:1789607958.167471:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541134976 00000100:00100000:0.0:1789607958.167522:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789607958.167532:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541134976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607958.167592:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1876539541134976:12345-0@lo:400:kworker.0 Request processed in 62us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607958.167600:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789607958.167661:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1876539541134976:0@lo:400:kworker.0 00000100:00080000:1.0:1789607958.169242:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789607958.169252:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607958.169255:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607958.169369:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607958.169505:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541134848 00000100:00100000:0.0:1789607958.169514:0:15114:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541134848 00000100:00100000:0.0:1789607958.169565:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789607958.169574:0:15114:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541134848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607958.169636:0:15114:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541134848:12345-0@lo:400:kworker.0 Request processed in 63us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607958.169666:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789607958.169844:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789607958.169861:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541134848:0@lo:400:kworker.0 00000100:00100000:2.0:1789607958.174194:0:15118:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541134464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14444us (15251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607958.174208:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789607958.178894:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541134464:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789607958.206756:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6e80d5c-081b-40da-8a54-f28641401897 00010000:00010000:2.0:1789607958.603792:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789607959.224165:0:16396:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789607959.628088:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607960.203892:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541135360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789607960.203976:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607960.204962:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541135360 00000100:00100000:2.0:1789607960.204972:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541135360 00000100:00100000:2.0:1789607960.205041:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607960.205052:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541135360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607960.205084:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607960.205139:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541135360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607960.205146:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789607960.205257:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541135360:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789607960.205325:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789607960.355589:0:6718:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e6e80d5c-081b-40da-8a54-f28641401897 00010000:00010000:0.0:1789607960.651645:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607960.882733:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607960.882796:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607960.882825:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607960.882849:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607960.882865:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607960.882880:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607960.882907:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607960.882938:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520169856 00000100:00100000:1.0:1789607960.882952:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520169856 00000100:00100000:3.0:1789607960.883002:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520169344 00000100:00100000:3.0:1789607960.883007:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520169344 00000100:00100000:1.0:1789607960.883023:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520169472 00000100:00100000:1.0:1789607960.883026:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520169472 00000100:00100000:1.0:1789607960.883044:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:3.0:1789607960.883045:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 104 00000100:00100000:3.0:1789607960.883055:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:2374:x1876539520169344:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607960.883055:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6e80d5c-081b-40da-8a54-f28641401897+6:2374:x1876539520169856:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:1.0:1789607960.883816:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6e80d5c-081b-40da-8a54-f28641401897+6:2374:x1876539520169856:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 757us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607960.883849:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:1.0:1789607960.883876:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:1.0:1789607960.883884:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:2374:x1876539520169472:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607960.884028:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520169600 00000100:00100000:0.0:1789607960.884036:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520169600 00000100:00100000:0.0:1789607960.884072:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520170112 00000100:00100000:0.0:1789607960.884075:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520170112 00000100:00100000:0.0:1789607960.884089:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520169728 00000100:00100000:0.0:1789607960.884091:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520169728 00000100:00100000:0.0:1789607960.884102:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520169984 00000100:00100000:0.0:1789607960.884105:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520169984 00000100:00100000:0.0:1789607960.884122:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:0.0:1789607960.884129:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2374:x1876539520169600:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607960.884729:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:2374:x1876539520169344:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 1671us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607960.884741:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 104 00000100:00100000:3.0:1789607960.884790:0:15115:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789607960.884799:0:15115:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789607960.885315:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:3.0:1789607960.885327:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520170112:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607960.885371:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520170112:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 49us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607960.885378:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:3.0:1789607960.885397:0:15115:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789607960.885405:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:3.0:1789607960.885412:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2374:x1876539520169728:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607960.885463:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2374:x1876539520169728:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 52us (2582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607960.885470:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:3.0:1789607960.885499:0:15115:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789607960.885506:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:3.0:1789607960.885513:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520169984:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607960.885539:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520169984:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 27us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607960.885545:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1789607960.886796:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2374:x1876539520169600:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 2653us (3984us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607960.886811:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00080000:0.0:1789607960.886864:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607960.886871:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607960.886875:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789607960.886971:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:2374:x1876539520169472:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 3085us (4102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607960.887293:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000040:00080000:1.0:1789607961.101978:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789607961.680667:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789607962.700699:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789607962.931514:0:16546:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcbcf64a20 20000000:00000080:3.0:1789607962.931544:0:16546:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a0c1091400 uarg=0000000000000000 20000000:01000000:3.0:1789607962.931594:0:16546:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789607962.931611:0:16546:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789607962.931617:0:16546:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789607962.933030:0:16547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1789607962.933763:0:16546:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789607962.946968:0:16546:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789607962.947010:0:16546:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.947044:0:16546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1f558e200/0x33f091d00138713c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001387135 expref: 18 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.947077:0:16546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1ff4eee00/0x33f091d001387189 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001387182 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.947085:0:16546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1ff7e2800/0x33f091d0013872c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d0013872bd expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.947097:0:16546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1f558ee00/0x33f091d0013873e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9976 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.947103:0:16546:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a1ff4efe00/0x33f091d00138741b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99d8 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.947110:0:16546:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.947325:0:16546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1ff4efe00/0x33f091d00138741b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99d8 expref: 12 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.947346:0:16546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1ff4efe00/0x33f091d00138741b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99d8 expref: 12 pid: 14424 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607962.947364:0:16546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f55a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16546:1876539541135488:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607962.947791:0:16546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1f558ee00/0x33f091d0013873e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9976 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.947802:0:16546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1f558ee00/0x33f091d0013873e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9976 expref: 12 pid: 14425 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607962.947812:0:16546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f55ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16546:1876539541135616:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607962.947855:0:16546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1ff7e2800/0x33f091d0013872c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d0013872bd expref: 18 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.947864:0:16546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1ff7e2800/0x33f091d0013872c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d0013872bd expref: 18 pid: 14424 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607962.947875:0:16546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f55a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16546:1876539541135744:0@lo:104: 00000100:00100000:0.0:1789607962.947923:0:16546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607962.947972:0:16546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1ff4eee00/0x33f091d001387189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001387182 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.947980:0:16546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1ff4eee00/0x33f091d001387189 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001387182 expref: 18 pid: 14425 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607962.947988:0:16546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2705880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16546:1876539541135872:0@lo:104: 00000100:00100000:0.0:1789607962.948009:0:16546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607962.948356:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541135744 00000100:00100000:2.0:1789607962.948368:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541135744 00000100:00100000:2.0:1789607962.948446:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541135872 00000100:00100000:2.0:1789607962.948450:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541135872 00000100:00100000:2.0:1789607962.948469:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607962.948481:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+4:16546:x1876539541135744:12345-0@lo:104: 00010000:00010000:2.0:1789607962.948506:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013872c4 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.948581:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789607962.948589:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+4:16546:x1876539541135744:12345-0@lo:104: Request processed in 110us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607962.948609:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789607962.948631:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789607962.948638:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+3:16546:x1876539541135872:12345-0@lo:104: 00010000:00010000:2.0:1789607962.948647:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001387189 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.948682:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789607962.948687:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+3:16546:x1876539541135872:12345-0@lo:104: Request processed in 50us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607962.948692:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789607962.948711:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789607962.948717:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d0013872c4 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.948725:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e3200 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607962.948729:0:14420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d0013872c4 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.948739:0:14420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d0013872c4 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607962.948747:0:14420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d0013872c4 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607962.948760:0:14420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607962.948800:0:14420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013872c4 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.948807:0:14420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607962.948833:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013872c4 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.948841:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e3200/0x33f091d0013872bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d0013872c4 expref: -99 pid: 15835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.948856:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607962.948860:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d001387189 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.948866:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1f558f400 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607962.948869:0:14420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d001387189 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.948876:0:14420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d001387189 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607962.948882:0:14420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d001387189 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607962.948888:0:14420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607962.948900:0:14420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001387189 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.948906:0:14420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607962.948927:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001387189 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.948934:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1f558f400/0x33f091d001387182 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d001387189 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.948943:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607962.948944:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607962.948946:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607962.948953:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607962.948969:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3312:1876539541136000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607962.949006:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789607962.949487:0:16546:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a1f558e200/0x33f091d00138713c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x33f091d001387135 expref: 18 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.949501:0:16546:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a1f558e200/0x33f091d00138713c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x33f091d001387135 expref: 18 pid: 14426 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607962.949514:0:16546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a0c2707800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16546:1876539541136256:0@lo:104: 00000100:00100000:0.0:1789607962.949561:0:16546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607962.949588:0:16546:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8ead3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789607962.949627:0:16546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f55a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16546:1876539541135744:0@lo:104: 00000100:00100000:0.0:1789607962.949636:0:16546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2705880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16546:1876539541135872:0@lo:104: 00000100:00100000:1.0:1789607962.949785:0:14414:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789607962.949800:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541136256 00000100:00100000:1.0:1789607962.949805:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541136256 00000100:00100000:1.0:1789607962.949838:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607962.949846:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1da7ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+3:16546:x1876539541136256:12345-0@lo:104: 00010000:00010000:1.0:1789607962.949858:0:14414:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d00138713c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.949913:0:14414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789607962.949918:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1da7ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+3:16546:x1876539541136256:12345-0@lo:104: Request processed in 74us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607962.949925:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789607962.949982:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3309:1876539541136128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607962.950011:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607962.950089:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541136000 00000100:00100000:1.0:1789607962.950093:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541136000 00010000:00010000:1.0:1789607962.950112:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1ff7e2800/0x33f091d0013872c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d0013872bd expref: 19 pid: 14424 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607962.950133:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541136128 00000100:00100000:1.0:1789607962.950158:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541136128 00010000:00010000:1.0:1789607962.950172:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1ff4eee00/0x33f091d001387189 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001387182 expref: 20 pid: 14425 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607962.950186:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607962.950192:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+20:3312:x1876539541136000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607962.950203:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607962.950209:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1ff7e2800/0x33f091d0013872c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d0013872bd expref: 20 pid: 14424 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.950220:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1ff7e2800/0x33f091d0013872c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d0013872bd expref: 20 pid: 14424 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.950239:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff7e2800/0x33f091d0013872c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d0013872bd expref: 20 pid: 14424 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.950255:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607962.950352:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:3312:x1876539541136000:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607962.950360:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789607962.950373:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607962.950379:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:3309:x1876539541136128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789607962.950387:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607962.950390:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1ff4eee00/0x33f091d001387189 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001387182 expref: 18 pid: 14425 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.950399:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1ff4eee00/0x33f091d001387189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001387182 expref: 18 pid: 14425 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.950409:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff4eee00/0x33f091d001387189 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001387182 expref: 18 pid: 14425 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.950446:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607962.950475:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:3309:x1876539541136128:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607962.950481:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789607962.950507:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3309:1876539541136128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607962.950558:0:16546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a0c2707800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16546:1876539541136256:0@lo:104: 00000100:00100000:2.0:1789607962.951464:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3312:1876539541136000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607962.951498:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789607962.951507:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x33f091d00138713c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.951517:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff7e2e00 already unused, calling callback (ffffffffc1b2cc20) 10000000:00010000:2.0:1789607962.951522:0:14420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x33f091d00138713c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.951533:0:14420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x33f091d00138713c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789607962.951552:0:14420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x33f091d00138713c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607962.951559:0:14420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789607962.951616:0:14420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d00138713c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.951635:0:14420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789607962.951664:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d00138713c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.951672:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.103@tcp lock: ffff99a1ff7e2e00/0x33f091d001387135 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x33f091d00138713c expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.951689:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607962.951691:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789607962.951693:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607962.951700:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607962.951711:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3309:1876539541136384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789607962.951768:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607962.951815:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541136384 00000100:00100000:2.0:1789607962.951822:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541136384 00010000:00010000:2.0:1789607962.951850:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1f558e200/0x33f091d00138713c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001387135 expref: 17 pid: 14426 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607962.951872:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607962.951880:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff532050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:3309:x1876539541136384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789607962.951892:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607962.951897:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1f558e200/0x33f091d00138713c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x33f091d001387135 expref: 17 pid: 14426 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.951906:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1f558e200/0x33f091d00138713c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x33f091d001387135 expref: 17 pid: 14426 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.951920:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1f558e200/0x33f091d00138713c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x33f091d001387135 expref: 17 pid: 14426 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.951949:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789607962.951982:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff532050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:3309:x1876539541136384:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607962.951990:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789607962.952049:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3309:1876539541136384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789607962.956871:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607962.956960:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607962.957111:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520170240 00000100:00100000:0.0:1789607962.957122:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520170240 00000100:00100000:2.0:1789607962.957125:0:16546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f55a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16546:1876539541135488:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607962.957138:0:16546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f55ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16546:1876539541135616:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607962.957184:0:16546:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607962.957190:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1ff4efe00/0x33f091d00138741b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99d8 expref: 13 pid: 14424 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607962.957217:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520170368 00000100:00100000:0.0:1789607962.957221:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520170368 00000100:00100000:2.0:1789607962.957224:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00010000:00010000:0.0:1789607962.957231:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a1f558ee00/0x33f091d0013873e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9976 expref: 14 pid: 14425 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607962.957235:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d77ce731-97c5-433c-91e3-ef21b84dcc39+14:2373:x1876539520170240:12345-192.168.202.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789607962.957243:0:14416:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789607962.957250:0:14416:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789607962.957253:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607962.957260:0:14418:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1ff4efe00/0x33f091d00138741b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99d8 expref: 14 pid: 14424 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.957274:0:14418:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1ff4efe00/0x33f091d00138741b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99d8 expref: 14 pid: 14424 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607962.957515:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1789607962.957525:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d77ce731-97c5-433c-91e3-ef21b84dcc39+14:2373:x1876539520170368:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607962.957534:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607962.957549:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a1f558ee00/0x33f091d0013873e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9976 expref: 14 pid: 14425 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.957559:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a1f558ee00/0x33f091d0013873e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9976 expref: 14 pid: 14425 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.957579:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1f558ee00/0x33f091d0013873e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9976 expref: 14 pid: 14425 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.957584:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ff4efe00/0x33f091d00138741b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99d8 expref: 14 pid: 14424 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.957851:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.957861:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.957868:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607962.957877:0:14416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.957889:0:14416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.957896:0:14416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.957903:0:14416:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.957909:0:14416:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ad400 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607962.957914:0:14416:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.957923:0:14416:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607962.957933:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d77ce731-97c5-433c-91e3-ef21b84dcc39+12:2373:x1876539520170240:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 700us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607962.957943:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00010000:00010000:1.0:1789607962.957946:0:14416:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607962.957956:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607962.957975:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d77ce731-97c5-433c-91e3-ef21b84dcc39+11:2373:x1876539520170368:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 454us (1015us total) trans 0 rc 0/0 00010000:00010000:2.0:1789607962.957976:0:16546:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607962.957983:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00010000:00010000:2.0:1789607962.957984:0:16546:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607962.957991:0:16546:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a1ee2ad400/0x33f091d001387445 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16546 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607963.275876:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541136896:0@lo:400:kworker.0 00000100:00100000:1.0:1789607963.275950:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607963.276014:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789607963.276021:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541136768:0@lo:400:kworker.0 00000100:00100000:1.0:1789607963.276044:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607963.276089:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541137280:0@lo:400:kworker.0 00000100:00100000:1.0:1789607963.276115:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789607963.276151:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541136896 00000100:00100000:1.0:1789607963.276159:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541136896 00000100:00100000:1.0:1789607963.276481:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541136768 00000100:00100000:1.0:1789607963.276486:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541136768 00000100:00100000:2.0:1789607963.276949:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541136512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607963.276995:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607963.277028:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541137024:0@lo:400:kworker.0 00000100:00100000:2.0:1789607963.277051:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607963.277086:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789607963.277093:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3311:1876539541136640:0@lo:400:kworker.0 00000100:00100000:2.0:1789607963.277121:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607963.277144:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541137152:0@lo:400:kworker.0 00000100:00100000:2.0:1789607963.277170:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607963.277220:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541136512 00000100:00100000:2.0:1789607963.277226:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541136512 00000100:00100000:2.0:1789607963.277260:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607963.277269:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541136512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789607963.277305:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607963.277350:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1876539541136512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607963.277357:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789607963.277382:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541136640 00000100:00100000:2.0:1789607963.277385:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541136640 00000100:00100000:2.0:1789607963.277445:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789607963.277453:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:3311:x1876539541136640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607963.277486:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:3311:x1876539541136640:12345-0@lo:400:kworker.0 Request processed in 34us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607963.277492:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789607963.277520:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541137280 00000100:00100000:2.0:1789607963.277523:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541137280 00000100:00100000:2.0:1789607963.277546:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541137024 00000100:00100000:2.0:1789607963.277548:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541137024 00000100:00100000:2.0:1789607963.277574:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541137152 00000100:00100000:2.0:1789607963.277577:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541137152 00000100:00100000:2.0:1789607963.277593:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789607963.277613:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541137280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607963.277653:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1876539541137280:12345-0@lo:400:kworker.0 Request processed in 42us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607963.277659:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789607963.277671:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789607963.277677:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541137024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607963.277706:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541137024:12345-0@lo:400:kworker.0 Request processed in 30us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607963.277712:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789607963.277725:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789607963.277731:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541137152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607963.277759:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541137152:12345-0@lo:400:kworker.0 Request processed in 29us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607963.277765:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789607963.278075:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3311:1876539541136640:0@lo:400:kworker.0 00000100:00100000:2.0:1789607963.278104:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541137152:0@lo:400:kworker.0 00000100:00100000:2.0:1789607963.278120:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541136512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789607963.278129:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541137024:0@lo:400:kworker.0 00000100:00100000:0.0:1789607963.278322:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607963.278333:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541136896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607963.278372:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201879880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541136896:12345-0@lo:400:kworker.0 Request processed in 42us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607963.278378:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789607963.278394:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789607963.278400:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a20187b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541136768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607963.278441:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a20187b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541136768:12345-0@lo:400:kworker.0 Request processed in 41us (2396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607963.278447:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789607963.278509:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1876539541137280:0@lo:400:kworker.0 00000100:00100000:2.0:1789607963.278526:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541136896:0@lo:400:kworker.0 00000100:00100000:2.0:1789607963.278546:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541136768:0@lo:400:kworker.0 00000100:00080000:1.0:1789607963.278737:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789607963.278742:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789607963.278745:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789607963.728246:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789607964.535279:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607964.535472:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520170496 00000100:00100000:3.0:1789607964.535488:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520170496 00000100:00100000:3.0:1789607964.535565:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 106 00000100:00100000:3.0:1789607964.535579:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+11:13785:x1876539520170496:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607964.535614:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607964.535642:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c0031600/0x33f091d00138744c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a09 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607964.535680:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c0031600/0x33f091d00138744c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a09 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607964.535697:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c0031600/0x33f091d00138744c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a09 expref: 12 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607964.535708:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c0031600, rc 0) 00000100:00100000:3.0:1789607964.535789:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+12:13785:x1876539520170496:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 213us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607964.535817:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 106 00000100:00100000:0.0:1789607964.541515:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607964.541723:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520170624 00000100:00100000:2.0:1789607964.541737:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520170624 00000100:00100000:2.0:1789607964.541803:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 107 00000100:00100000:2.0:1789607964.541813:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+12:13785:x1876539520170624:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.542184:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d77ce731-97c5-433c-91e3-ef21b84dcc39+12:13785:x1876539520170624:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 370us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607964.542193:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 107 00000100:00100000:1.0:1789607964.547474:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607964.548199:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520170752 00000100:00100000:3.0:1789607964.548213:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520170752 00000100:00100000:3.0:1789607964.548478:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 108 00000100:00100000:3.0:1789607964.548492:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+12:13785:x1876539520170752:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607964.549985:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+12:13785:x1876539520170752:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 1486us (2515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607964.549998:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 108 00000100:00100000:0.0:1789607964.576734:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607964.578195:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520170880 00000100:00100000:3.0:1789607964.578218:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520170880 00000100:00100000:3.0:1789607964.578458:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 109 00000100:00100000:3.0:1789607964.578473:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+12:13785:x1876539520170880:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607964.578497:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607964.579035:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c0031000/0x33f091d001387453 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a10 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607964.579079:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c0031000/0x33f091d001387453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a10 expref: 13 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607964.579094:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c0031000/0x33f091d001387453 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a10 expref: 13 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607964.579106:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c0031000, rc 0) 00000100:00100000:3.0:1789607964.579679:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13785:x1876539520170880:12345-192.168.202.3@tcp:101:ll_cfg_requeue.0 Request processed in 1205us (2956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607964.579690:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 109 00000100:00100000:1.0:1789607964.593238:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607964.598477:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520171008 00000100:00100000:3.0:1789607964.598502:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520171008 00000100:00100000:2.0:1789607964.599600:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 110 00000100:00100000:2.0:1789607964.599619:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13785:x1876539520171008:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.600042:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13785:x1876539520171008:12345-192.168.202.3@tcp:501:ll_cfg_requeue.0 Request processed in 427us (6819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607964.600051:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 110 00000100:00100000:3.0:1789607964.602279:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607964.602324:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520171136 00000100:00100000:3.0:1789607964.602336:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520171136 00000100:00100000:3.0:1789607964.602405:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 111 00000100:00100000:3.0:1789607964.602419:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13785:x1876539520171136:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607964.602785:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:13785:x1876539520171136:12345-192.168.202.3@tcp:503:ll_cfg_requeue.0 Request processed in 368us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607964.602797:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 111 00010000:00010000:0.0:1789607964.748452:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789607964.875942:0:14428:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789607964.875952:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1c6582000 from 10 10000000:01000000:3.0:1789607964.875958:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789607964.876022:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c0030200/0x33f091d00138745a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607964.876037:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1c0030200/0x33f091d00138745a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607964.876051:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1c0030200/0x33f091d00138745a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607964.876086:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541137408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789607964.876189:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607964.876244:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a200c4cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607964.877637:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541137408 00000100:00100000:3.0:1789607964.877653:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541137408 00000100:00100000:2.0:1789607964.878219:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789607964.878232:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+16:14428:x1876539541137408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607964.878261:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607964.878293:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103b200/0x33f091d001387461 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d00138745a expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.878327:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103b200/0x33f091d001387461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d00138745a expref: 17 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.878339:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103b200/0x33f091d001387461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d00138745a expref: 17 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.878350:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b200, rc 0) 00000100:00100000:2.0:1789607964.878457:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:14428:x1876539541137408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607964.878465:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789607964.878563:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541137408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607964.878596:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1c0030200/0x33f091d00138745a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387461 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.878608:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1c0030200/0x33f091d00138745a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d001387461 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607964.878706:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541137536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.878754:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607964.878957:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f51199c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607964.878987:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541137536 00000100:00100000:2.0:1789607964.878993:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541137536 00000100:00100000:2.0:1789607964.879019:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789607964.879026:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:14428:x1876539541137536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.879362:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:14428:x1876539541137536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 335us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607964.879370:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789607964.879408:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541137536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.879474:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541137664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.879831:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607964.879864:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f51199c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607964.880003:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541137664 00000100:00100000:2.0:1789607964.880009:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541137664 00000100:00100000:2.0:1789607964.880039:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789607964.880046:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:14428:x1876539541137664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.880230:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff844c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:14428:x1876539541137664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607964.880239:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789607964.880361:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541137664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789607964.881811:0:16630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789607964.881929:0:14428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789607964.881953:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607964.881967:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1c0030200/0x33f091d00138745a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387461 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.881981:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1c0030200/0x33f091d00138745a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d001387461 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607964.881993:0:14428:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607964.882003:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a1d0ab7800 from 10 10000000:01000000:2.0:1789607964.882006:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607964.882053:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001387468 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.882062:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001387468 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.882072:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001387468 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607964.882099:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541137792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.882168:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607964.882219:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f5119780 going to sleep for 11 seconds 00000100:00100000:3.0:1789607964.882499:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541137792 00000100:00100000:3.0:1789607964.882509:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541137792 00000100:00100000:3.0:1789607964.882564:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789607964.882593:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+17:14428:x1876539541137792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607964.882611:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607964.882628:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1c1510400/0x33f091d00138746f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001387468 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607964.882659:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1c1510400/0x33f091d00138746f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001387468 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607964.882672:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1c1510400/0x33f091d00138746f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001387468 expref: 18 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607964.882682:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1510400, rc 0) 00000100:00100000:3.0:1789607964.882728:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:14428:x1876539541137792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607964.882736:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789607964.882852:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541137792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789607964.882869:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001387468 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138746f expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607964.883132:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001387468 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138746f expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607964.883203:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541137920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607964.883237:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607964.883701:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a200c4c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607964.883723:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541137920 00000100:00100000:3.0:1789607964.883730:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541137920 00000100:00100000:2.0:1789607964.884390:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789607964.884402:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:14428:x1876539541137920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.885258:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:14428:x1876539541137920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 853us (2015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607964.885390:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541137920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607964.885483:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541138048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.885632:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789607964.885835:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607964.886079:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541138048 00000100:00100000:2.0:1789607964.886088:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541138048 00000100:00100000:2.0:1789607964.886156:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789607964.886165:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:14428:x1876539541138048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789607964.886597:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a200c4c900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607964.887450:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541138048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.887861:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:14428:x1876539541138048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1695us (2024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607964.887874:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000040:00080000:3.0:1789607964.889112:0:16631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789607964.889350:0:14428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789607964.889376:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607964.889398:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001387468 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138746f expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.889411:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d103a800/0x33f091d001387468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138746f expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789607964.893084:0:14428:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789607964.893096:0:14428:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a0c31fe000 from 10 10000000:01000000:2.0:1789607964.893104:0:14428:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789607964.893161:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103ba00/0x33f091d001387476 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.893175:0:14428:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.103@tcp lock: ffff99a1d103ba00/0x33f091d001387476 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.893189:0:14428:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.103@tcp lock: ffff99a1d103ba00/0x33f091d001387476 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607964.893218:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541138176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.893760:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607964.893874:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f5119840 going to sleep for 11 seconds 00000100:00100000:2.0:1789607964.894030:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541138176 00000100:00100000:2.0:1789607964.894041:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541138176 00000100:00100000:2.0:1789607964.894111:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789607964.894121:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+18:14428:x1876539541138176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607964.894138:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607964.894156:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a1d103be00/0x33f091d00138747d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x33f091d001387476 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.894187:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a1d103be00/0x33f091d00138747d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x33f091d001387476 expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.894216:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a1d103be00/0x33f091d00138747d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x33f091d001387476 expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.894227:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103be00, rc 0) 00000100:00100000:2.0:1789607964.894345:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:14428:x1876539541138176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607964.894354:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789607964.894410:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541138176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789607964.894447:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.103@tcp lock: ffff99a1d103ba00/0x33f091d001387476 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138747d expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.894458:0:14428:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.103@tcp lock: ffff99a1d103ba00/0x33f091d001387476 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x33f091d00138747d expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607964.894732:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541138304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.895046:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607964.895084:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f5119840 going to sleep for 11 seconds 00000100:00100000:3.0:1789607964.895138:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541138304 00000100:00100000:3.0:1789607964.895145:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541138304 00000100:00100000:3.0:1789607964.895215:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789607964.895225:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:14428:x1876539541138304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789607964.895942:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:14428:x1876539541138304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 541us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607964.895954:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789607964.896490:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541138304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.896640:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541138432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.896866:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607964.896965:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f5119840 going to sleep for 11 seconds 00000100:00100000:2.0:1789607964.897509:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541138432 00000100:00100000:2.0:1789607964.897518:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541138432 00000100:00100000:2.0:1789607964.897648:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789607964.897719:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:14428:x1876539541138432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789607964.898159:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:14428:x1876539541138432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 501us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607964.898170:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789607964.898233:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:14428:1876539541138432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789607964.900033:0:16633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789607964.900211:0:14428:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789607964.900237:0:14428:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789607964.900252:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.103@tcp lock: ffff99a1d103ba00/0x33f091d001387476 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138747d expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607964.900332:0:14428:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.103@tcp lock: ffff99a1d103ba00/0x33f091d001387476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x33f091d00138747d expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607965.330154:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541138560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789607965.330253:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607965.330362:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541138560 00000100:00100000:2.0:1789607965.330372:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541138560 00000100:00100000:2.0:1789607965.330463:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789607965.330476:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541138560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607965.330535:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607965.331645:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541138560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1169us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607965.331658:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789607965.331695:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789607965.338911:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541138560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789607965.776332:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607966.004531:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607966.004597:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607966.004628:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607966.004668:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607966.004692:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607966.004709:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607966.004743:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607966.004936:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520171648 00000100:00100000:3.0:1789607966.004949:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520171648 00000100:00100000:3.0:1789607966.005017:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520171904 00000100:00100000:3.0:1789607966.005021:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520171904 00000100:00100000:3.0:1789607966.005035:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520171520 00000100:00100000:3.0:1789607966.005056:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520171520 00000100:00100000:3.0:1789607966.005080:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520172032 00000100:00100000:3.0:1789607966.005082:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520172032 00000100:00100000:3.0:1789607966.005100:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1789607966.005112:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2374:x1876539520171648:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607966.006051:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2374:x1876539520171648:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 935us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607966.006064:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:3.0:1789607966.006097:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:3.0:1789607966.006109:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520171904:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607966.006146:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520171904:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 42us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607966.006153:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:3.0:1789607966.006164:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:3.0:1789607966.006171:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2374:x1876539520171520:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607966.006371:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2374:x1876539520171520:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 200us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607966.006379:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:3.0:1789607966.006392:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:3.0:1789607966.006400:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520172032:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607966.006448:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520172032:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 48us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607966.006454:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:2.0:1789607966.006887:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520171392 00000100:00100000:2.0:1789607966.006896:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520171392 00000100:00100000:2.0:1789607966.006943:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520171776 00000100:00100000:2.0:1789607966.006947:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520171776 00000100:00100000:2.0:1789607966.006983:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:2.0:1789607966.006990:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:2374:x1876539520171392:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607966.007032:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:2374:x1876539520171392:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 42us (2523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607966.007039:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:2.0:1789607966.007052:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:2.0:1789607966.007059:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6e80d5c-081b-40da-8a54-f28641401897+6:2374:x1876539520171776:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607966.007084:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6e80d5c-081b-40da-8a54-f28641401897+6:2374:x1876539520171776:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 25us (2373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607966.007090:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:2.0:1789607966.007112:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520171264 00000100:00100000:2.0:1789607966.007116:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520171264 00000100:00100000:2.0:1789607966.007143:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 121 00000100:00100000:2.0:1789607966.007149:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:2374:x1876539520171264:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:2.0:1789607966.007173:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:2374:x1876539520171264:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 25us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607966.007190:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 121 00000100:00080000:2.0:1789607966.007223:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789607966.007228:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607966.007231:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607966.619156:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607966.619311:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520172160 00000100:00100000:2.0:1789607966.619325:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520172160 00000100:00100000:2.0:1789607966.619410:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:2.0:1789607966.619464:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:14442:x1876539520172160:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607966.619495:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607966.619533:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387484 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a17 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.619637:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138748b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.619655:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138748b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.619673:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138748b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.619691:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387492 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.619698:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.619705:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.620520:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001387499 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.620536:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001387499 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.620546:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001387499 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607966.620593:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607966.620598:0:14433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607966.620649:0:14433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001387499 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.620668:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138748b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.620675:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138748b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.620684:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138748b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.620690:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607966.620694:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138748b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.620702:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138748b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.620717:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c5961600) 00010000:00010000:2.0:1789607966.620720:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607966.620726:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138748b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.620732:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138748b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.620747:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387492 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.622004:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387492 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.622012:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387492 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.622034:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103aa00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607966.622040:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387492 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.622048:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387492 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.622064:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99a1c5961800) 00010000:00010000:2.0:1789607966.622066:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607966.622071:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387492 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.622077:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387492 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.622148:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387484 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a17 expref: 8 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.622163:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103bc00/0x33f091d001387499 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a17 expref: 7 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.622171:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99a1c5961700) 00010000:00010000:2.0:1789607966.622173:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607966.622176:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103bc00, rc 0) 00000100:00100000:2.0:1789607966.622273:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:14442:x1876539520172160:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 2851us (3131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607966.622283:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:0.0:1789607966.625167:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607966.625291:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520172416 00000100:00100000:1.0:1789607966.625306:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520172416 00000100:00100000:1.0:1789607966.625386:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:1.0:1789607966.625399:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:14442:x1876539520172416:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789607966.625450:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607966.625483:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013874a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a1e expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.625607:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874a7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.625626:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.625643:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.628610:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ae lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.628659:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.628672:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629574:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d0013874b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629590:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d0013874b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629599:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d0013874b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607966.629613:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789607966.629823:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874a7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629831:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874a7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629839:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629846:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eec00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607966.629850:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874a7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629858:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874a7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629880:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99a1c5961700) 00010000:00010000:1.0:1789607966.629883:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607966.629888:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629895:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629906:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ae lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629912:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ae lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629918:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629924:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607966.629926:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ae lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629932:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ae lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629938:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99a1c2fa2500) 00010000:00010000:1.0:1789607966.629940:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607966.629942:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ae lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.629948:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ae lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.631415:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013874a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a1e expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.631463:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee000/0x33f091d0013874b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a1e expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.631472:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1c2fa2d00) 00010000:00010000:1.0:1789607966.631475:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607966.631478:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee000, rc 0) 00000100:00100000:1.0:1789607966.631551:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+9:14442:x1876539520172416:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 6155us (6400us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789607966.631560:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:3.0:1789607966.641225:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607966.641398:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520172544 00000100:00100000:2.0:1789607966.641479:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520172544 00000100:00100000:2.0:1789607966.641587:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:2.0:1789607966.641602:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+9:14442:x1876539520172544:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789607966.641750:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+9:14442:x1876539520172544:12345-192.168.202.3@tcp:59:lhsmtool_posix.0 Request processed in 151us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607966.641758:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:3.0:1789607966.719917:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607966.720258:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520172672 00000100:00100000:1.0:1789607966.720271:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520172672 00000100:00100000:1.0:1789607966.720480:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:1.0:1789607966.720493:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+9:14448:x1876539520172672:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607966.720534:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607966.720571:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013874c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a25 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.720656:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.720677:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.720693:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.720727:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.720735:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.720742:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721226:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721246:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721255:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721262:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607966.721268:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721277:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721290:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c5961600) 00010000:00010000:1.0:1789607966.721293:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607966.721299:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721306:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013874ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721326:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721332:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721576:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721583:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4eec00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607966.721586:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721593:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721602:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99a1c2fa2500) 00010000:00010000:1.0:1789607966.721604:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607966.721608:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721615:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721660:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013874c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a25 expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721673:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c5961600) 00010000:00010000:1.0:1789607966.721675:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607966.721685:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013874c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a25 expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.721696:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef600, rc 0) 00000100:00100000:1.0:1789607966.721782:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+9:14448:x1876539520172672:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 1290us (1881us total) trans 0 rc 301/301 00000100:00100000:1.0:1789607966.721792:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:0.0:1789607966.725867:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607966.725995:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520172800 00000100:00100000:3.0:1789607966.726012:0:14440:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520172800 00000100:00100000:3.0:1789607966.726092:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:3.0:1789607966.726106:0:14440:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3e4d0e76-8b10-4097-8a3e-1656392a0727+9:14448:x1876539520172800:12345-192.168.202.3@tcp:700:lfs.0 00000100:00100000:3.0:1789607966.726214:0:14440:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3e4d0e76-8b10-4097-8a3e-1656392a0727+9:14448:x1876539520172800:12345-192.168.202.3@tcp:700:lfs.0 Request processed in 112us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607966.726221:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:3.0:1789607966.728836:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607966.729170:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520173056 00000100:00100000:2.0:1789607966.729182:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520173056 00000100:00100000:2.0:1789607966.729306:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:2.0:1789607966.729322:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+9:14448:x1876539520173056:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:2.0:1789607966.729402:0:14433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607966.729463:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387406 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b99a0 expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.729486:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c5961600) 00010000:00010000:2.0:1789607966.729492:0:14433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607966.733389:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.733434:0:14433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138743e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a02 expref: 5 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.733446:0:14433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.733517:0:14433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138743e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a02 expref: 5 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.733555:0:14433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138743e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a02 expref: 5 pid: 14432 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607966.733586:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4af100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14433:1876539541138688:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607966.733718:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f5119b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789607966.737747:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607966.737763:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4af100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14433:1876539541138688:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607966.737799:0:14433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607966.737839:0:16548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520173184 00000100:00100000:1.0:1789607966.737849:0:16548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520173184 00010000:00010000:1.0:1789607966.737907:0:16548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138743e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a02 expref: 6 pid: 14432 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607966.737952:0:16548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:1.0:1789607966.737964:0:16548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6e80d5c-081b-40da-8a54-f28641401897+6:2374:x1876539520173184:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607966.737984:0:16548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607966.737993:0:16548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138743e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a02 expref: 6 pid: 14432 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.738006:0:16548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138743e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a02 expref: 6 pid: 14432 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.738032:0:16548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c0030a00/0x33f091d00138743e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a02 expref: 6 pid: 14432 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.738054:0:16548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c5961600) 00010000:00010000:1.0:1789607966.738059:0:16548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.738102:0:16548:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.738112:0:16548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.738149:0:16548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607966.738219:0:16548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520173184:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 256us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607966.738227:0:16548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00010000:00010000:0.0:1789607966.740704:0:14433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607966.740751:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607966.740796:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013874df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607966.740812:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013874df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607966.740828:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013874df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607966.742636:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789607966.742659:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607966.742670:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607966.742679:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607966.742686:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607966.742692:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607966.742700:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607966.742722:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c5961600) 00010000:00010000:0.0:1789607966.742725:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607966.742740:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607966.742747:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d0013874d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607966.742775:0:14433:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d5fe3c4 reply state 0000000025b3aba5 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013874df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607966.742784:0:14433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789607966.742934:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+10:14448:x1876539520173056:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 13610us (14104us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789607966.742947:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00010000:00010000:3.0:1789607966.748414:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013874df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.748473:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013874df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.748483:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013874df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.748490:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607966.748497:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013874df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.748507:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013874df lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.748529:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99a1f911d400) 00010000:00010000:3.0:1789607966.748532:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607966.748539:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013874df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.748578:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013874df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607966.797434:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607966.840506:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607966.840654:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520173312 00000100:00100000:1.0:1789607966.840670:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520173312 00000100:00100000:1.0:1789607966.840865:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:1.0:1789607966.840877:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+9:14456:x1876539520173312:12345-192.168.202.3@tcp:101:lctl.0 00010000:00010000:1.0:1789607966.840912:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607966.840944:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013874e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a2c expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.841091:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.841109:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.841124:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607966.841170:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789607966.841174:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607966.841312:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.841345:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013874e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a2c expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.841369:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eec00/0x33f091d0013874ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a2c expref: 10 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.841379:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c2fa2500) 00010000:00010000:1.0:1789607966.841386:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789607966.841391:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4eec00, rc 0) 00000100:00100000:1.0:1789607966.841526:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+10:14456:x1876539520173312:12345-192.168.202.3@tcp:101:lctl.0 Request processed in 652us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607966.841535:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:0.0:1789607966.919357:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607966.919665:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520173440 00000100:00100000:2.0:1789607966.919677:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520173440 00000100:00100000:2.0:1789607966.919881:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:2.0:1789607966.919890:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6e80d5c-081b-40da-8a54-f28641401897+5:14457:x1876539520173440:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607966.919915:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607966.919940:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013874f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a33 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.920035:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013874fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.920054:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013874fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.920069:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013874fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607966.920116:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607966.920137:0:14433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607966.920170:0:14433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013874fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.920214:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013874f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a33 expref: 7 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.920239:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b000/0x33f091d0013874fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a33 expref: 6 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.920246:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c2fa2500) 00010000:00010000:2.0:1789607966.920248:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607966.920252:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b000, rc 0) 00000100:00100000:2.0:1789607966.920322:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6e80d5c-081b-40da-8a54-f28641401897+6:14457:x1876539520173440:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 433us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607966.920328:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:2.0:1789607966.935595:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607966.935924:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520173568 00000100:00100000:3.0:1789607966.935937:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520173568 00000100:00100000:3.0:1789607966.936016:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:3.0:1789607966.936030:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6e80d5c-081b-40da-8a54-f28641401897+6:14457:x1876539520173568:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:3.0:1789607966.936059:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607966.936087:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d001387502 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a3a expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.936173:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387509 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.936203:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387509 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.936218:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387509 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.936235:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d001387510 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.936243:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d001387510 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.936250:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d001387510 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.940522:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387517 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.940546:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.940569:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607966.940619:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789607966.940624:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607966.940645:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387517 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.940659:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387509 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.940666:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387509 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.940673:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387509 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.940678:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1510a00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607966.940683:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387509 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.940690:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387509 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.940702:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c2fa2500) 00010000:00010000:3.0:1789607966.940720:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607966.940727:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387509 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.940734:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387509 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.942949:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d001387510 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.942966:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d001387510 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.942974:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d001387510 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.942979:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1511e00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607966.942984:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d001387510 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.942992:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d001387510 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.943007:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99a1c3982700) 00010000:00010000:3.0:1789607966.943010:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607966.943015:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d001387510 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.943021:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d001387510 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.943074:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d001387502 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a3a expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.943114:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387517 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a3a expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.943122:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a1c3982000) 00010000:00010000:3.0:1789607966.943124:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789607966.943127:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1510200, rc 0) 00000100:00100000:3.0:1789607966.943212:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6e80d5c-081b-40da-8a54-f28641401897+7:14457:x1876539520173568:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 7184us (7634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607966.943221:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:3.0:1789607966.951927:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607966.952036:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520173824 00000100:00100000:1.0:1789607966.952054:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520173824 00000100:00100000:1.0:1789607966.952138:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:1.0:1789607966.952153:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6e80d5c-081b-40da-8a54-f28641401897+7:14457:x1876539520173824:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607966.952182:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607966.952211:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d00138751e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a41 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607966.952340:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789607966.952598:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d00138751e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a41 expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.952617:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c2fa2500) 00010000:00010000:1.0:1789607966.952639:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607966.952651:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d00138751e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a41 expref: 9 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.952669:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef600, rc 0) 00000100:00100000:1.0:1789607966.952750:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6e80d5c-081b-40da-8a54-f28641401897+8:14457:x1876539520173824:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 600us (834us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789607966.952759:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:0.0:1789607966.956995:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607966.957100:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520174080 00000100:00100000:3.0:1789607966.957113:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520174080 00000100:00100000:3.0:1789607966.957184:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:3.0:1789607966.957197:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6e80d5c-081b-40da-8a54-f28641401897+8:14457:x1876539520174080:12345-192.168.202.3@tcp:36:lfs.0 00010000:00010000:3.0:1789607966.957285:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607966.957320:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387517 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a3a expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.957346:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a1c3982000) 00010000:00010000:3.0:1789607966.957358:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789607966.957391:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138752c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.957417:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138752c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.957879:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138752c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607966.958220:0:14432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f27828c8 reply state 000000008902b1b4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138752c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607966.958235:0:14432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789607966.958245:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789607966.958357:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6e80d5c-081b-40da-8a54-f28641401897+9:14457:x1876539520174080:12345-192.168.202.3@tcp:36:lfs.0 Request processed in 1162us (1377us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789607966.958365:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 24 00000100:00100000:2.0:1789607966.970950:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607966.971034:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520174336 00000100:00100000:1.0:1789607966.971046:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520174336 00000100:00100000:1.0:1789607966.971116:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:1.0:1789607966.971130:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6e80d5c-081b-40da-8a54-f28641401897+9:14457:x1876539520174336:12345-192.168.202.3@tcp:35:lfs.0 00010000:00010000:3.0:1789607966.971168:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138752c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.971183:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138752c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.971192:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138752c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.971198:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1511200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607966.971203:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138752c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.971213:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138752c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.971234:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a1c3982700) 00010000:00010000:3.0:1789607966.971237:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789607966.971242:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138752c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607966.971248:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138752c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607966.971465:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6e80d5c-081b-40da-8a54-f28641401897+9:14457:x1876539520174336:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 336us (526us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789607966.971474:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:3.0:1789607966.977096:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607966.977177:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520174592 00000100:00100000:1.0:1789607966.977195:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520174592 00000100:00100000:1.0:1789607966.977278:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:1.0:1789607966.977291:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6e80d5c-081b-40da-8a54-f28641401897+9:14457:x1876539520174592:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607966.977326:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607966.977355:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387533 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a48 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.977500:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138753a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.977521:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138753a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.977589:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138753a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.977611:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387541 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.977618:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387541 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.977624:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387541 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607966.977791:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789607966.977921:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138753a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.977931:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138753a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.977938:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138753a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.977945:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607966.977950:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138753a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.977960:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138753a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.977975:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c2fa2500) 00010000:00010000:1.0:1789607966.977978:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607966.977993:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138753a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.978000:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138753a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.978015:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387541 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.978022:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387541 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.978028:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387541 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.978033:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607966.978036:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387541 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.978041:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387541 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.978049:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99a1c2fa2100) 00010000:00010000:1.0:1789607966.978052:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607966.978055:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387541 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.978061:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387541 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.978107:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387533 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a48 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.978131:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c2fa2500) 00010000:00010000:1.0:1789607966.978134:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789607966.978139:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a48 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607966.978150:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ef600, rc 0) 00000100:00100000:1.0:1789607966.978233:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6e80d5c-081b-40da-8a54-f28641401897+10:14457:x1876539520174592:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 944us (1149us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789607966.978244:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 25 00000100:00100000:0.0:1789607966.981075:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607966.981142:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520174720 00000100:00100000:2.0:1789607966.981154:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520174720 00000100:00100000:2.0:1789607966.981236:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:2.0:1789607966.981269:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6e80d5c-081b-40da-8a54-f28641401897+10:14457:x1876539520174720:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607966.981302:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607966.981331:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d00138754f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a4f expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.981493:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b600/0x33f091d001387556 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.981510:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b600/0x33f091d001387556 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.981524:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b600/0x33f091d001387556 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607966.981578:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789607966.981583:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607966.981605:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b600/0x33f091d001387556 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.981636:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d00138754f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a4f expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.981658:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b600/0x33f091d001387556 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a4f expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607966.981666:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a1c5961800) 00010000:00010000:2.0:1789607966.981669:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789607966.981673:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b600, rc 0) 00000100:00100000:2.0:1789607966.981758:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6e80d5c-081b-40da-8a54-f28641401897+11:14457:x1876539520174720:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 493us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607966.981775:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 26 00000100:00100000:2.0:1789607966.988148:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607966.988395:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520174848 00000100:00100000:3.0:1789607966.988410:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520174848 00000100:00100000:3.0:1789607966.988529:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:3.0:1789607966.988541:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6e80d5c-081b-40da-8a54-f28641401897+11:14457:x1876539520174848:12345-192.168.202.3@tcp:37:lfs.0 00000100:00100000:1.0:1789607966.997221:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6e80d5c-081b-40da-8a54-f28641401897+11:14457:x1876539520174848:12345-192.168.202.3@tcp:37:lfs.0 Request processed in 8669us (9074us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607966.997235:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 3 00000100:00100000:0.0:1789607967.006074:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607967.006152:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520175104 00000100:00100000:1.0:1789607967.006168:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520175104 00000100:00100000:1.0:1789607967.006253:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:1.0:1789607967.006266:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c2f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6e80d5c-081b-40da-8a54-f28641401897+11:14457:x1876539520175104:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1789607967.006640:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c2f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6e80d5c-081b-40da-8a54-f28641401897+12:14457:x1876539520175104:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 375us (581us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789607967.006649:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 4 00000100:00100000:2.0:1789607967.108805:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607967.108950:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520175232 00000100:00100000:1.0:1789607967.108966:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520175232 00000100:00100000:1.0:1789607967.109050:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:1.0:1789607967.109062:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+10:14463:x1876539520175232:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:1.0:1789607967.109088:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607967.109134:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d00138755d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a56 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109234:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387564 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109262:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387564 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109277:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387564 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109294:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138756b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109302:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138756b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109309:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138756b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109416:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eea00/0x33f091d001387572 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109464:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eea00/0x33f091d001387572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109473:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eea00/0x33f091d001387572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607967.109507:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789607967.109511:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789607967.109579:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eea00/0x33f091d001387572 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109602:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387564 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109608:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387564 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109615:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387564 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109622:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ee200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607967.109627:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387564 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109636:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387564 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109651:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c2fa2500) 00010000:00010000:1.0:1789607967.109654:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607967.109660:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387564 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109667:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387564 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109683:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138756b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109689:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138756b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109694:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138756b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109706:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efc00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607967.109709:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138756b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109716:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138756b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109724:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99a1c2fa2100) 00010000:00010000:1.0:1789607967.109726:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607967.109729:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138756b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109735:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d00138756b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109779:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d00138755d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a56 expref: 12 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109795:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4eea00/0x33f091d001387572 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a56 expref: 11 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.109802:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a1c5961800) 00010000:00010000:1.0:1789607967.109804:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789607967.109807:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4eea00, rc 0) 00000100:00100000:1.0:1789607967.109897:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+11:14463:x1876539520175232:12345-192.168.202.3@tcp:101:bash.0 Request processed in 837us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607967.109906:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 27 00000100:00100000:3.0:1789607967.114821:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607967.117034:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520175488 00000100:00100000:2.0:1789607967.117056:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520175488 00000100:00100000:2.0:1789607967.117197:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 28 00000100:00100000:2.0:1789607967.117210:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+11:14463:x1876539520175488:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607967.117371:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607967.117404:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387579 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a5d expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.117609:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.117629:0:14432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b600/0x33f091d001387556 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a4f expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.117639:0:14432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.117689:0:14432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b600/0x33f091d001387556 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a4f expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.117707:0:14432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b600/0x33f091d001387556 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a4f expref: 11 pid: 14432 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607967.118404:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14432:1876539541138816:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607967.118675:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f50d86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607967.125214:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14432:1876539541138816:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607967.125269:0:14432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607967.129745:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607967.130048:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520175616 00000100:00100000:1.0:1789607967.130077:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520175616 00010000:00010000:1.0:1789607967.130136:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b600/0x33f091d001387556 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a4f expref: 12 pid: 14432 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607967.130194:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:1.0:1789607967.130206:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6e80d5c-081b-40da-8a54-f28641401897+12:2373:x1876539520175616:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607967.130225:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607967.130233:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b600/0x33f091d001387556 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a4f expref: 12 pid: 14432 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.130262:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b600/0x33f091d001387556 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a4f expref: 12 pid: 14432 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.130299:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b600/0x33f091d001387556 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a4f expref: 12 pid: 14432 timeout: 600 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.130321:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a1c5961800) 00010000:00010000:1.0:1789607967.130328:0:14416:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.130342:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.130352:0:14416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.130392:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607967.130546:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e6e80d5c-081b-40da-8a54-f28641401897+11:2373:x1876539520175616:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 341us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607967.130579:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00010000:00010000:2.0:1789607967.131373:0:14432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.131384:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.131414:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001387587 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.131453:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001387587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.131462:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001387587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.143177:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b400/0x33f091d00138758e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.143205:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b400/0x33f091d00138758e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.143220:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b400/0x33f091d00138758e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607967.143240:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789607967.143299:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.143326:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.143333:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.143339:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607967.143343:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.143352:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.143365:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a1c5961800) 00010000:00010000:2.0:1789607967.143368:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607967.143372:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.143378:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d001387580 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789607967.143395:0:14432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd6097b2 reply state 000000001ba950e5 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001387587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607967.143404:0:14432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789607967.143483:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387579 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a5d expref: 14 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.143500:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b400/0x33f091d00138758e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a5d expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.143519:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:2.0:1789607967.143521:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789607967.143524:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b400, rc 0) 00000100:00100000:2.0:1789607967.144170:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+14:14463:x1876539520175488:12345-192.168.202.3@tcp:101:bash.0 Request processed in 26959us (29361us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789607967.144180:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 28 00010000:00010000:1.0:1789607967.155578:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001387587 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.155596:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001387587 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.155605:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001387587 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.155611:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103ae00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607967.155617:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001387587 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.155625:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001387587 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.155641:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99a1c5961c00) 00010000:00010000:1.0:1789607967.155644:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607967.155648:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001387587 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.155654:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ae00/0x33f091d001387587 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607967.166337:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607967.167916:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520175744 00000100:00100000:2.0:1789607967.167932:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520175744 00000100:00100000:2.0:1789607967.168002:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:2.0:1789607967.168013:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+13:14463:x1876539520175744:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607967.168041:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607967.168064:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138759c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a64 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.168152:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013875a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.168166:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013875a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.168180:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013875a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607967.168220:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789607967.168224:0:14433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607967.168243:0:14433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013875a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.168270:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013875a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.168296:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138759c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a64 expref: 15 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.168314:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013875a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a64 expref: 14 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.168321:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:2.0:1789607967.168324:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607967.168328:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a600, rc 0) 00000100:00100000:2.0:1789607967.168396:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+14:14463:x1876539520175744:12345-192.168.202.3@tcp:101:bash.0 Request processed in 385us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607967.168403:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 29 00000100:00100000:0.0:1789607967.174597:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607967.174690:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520176000 00000100:00100000:1.0:1789607967.174706:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520176000 00000100:00100000:1.0:1789607967.174782:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 5 00000100:00100000:1.0:1789607967.174795:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+14:14463:x1876539520176000:12345-192.168.202.3@tcp:35:bash.0 00000100:00100000:1.0:1789607967.175192:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+15:14463:x1876539520176000:12345-192.168.202.3@tcp:35:bash.0 Request processed in 398us (770us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789607967.175215:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 5 00000040:00080000:3.0:1789607967.244496:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789607967.318410:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607967.318593:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520176256 00000100:00100000:2.0:1789607967.318610:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520176256 00000100:00100000:2.0:1789607967.318715:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:2.0:1789607967.318727:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+15:14473:x1876539520176256:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607967.318752:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607967.318776:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a6b expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607967.318877:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789607967.319003:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a6b expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.319033:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c2fa2500) 00010000:00010000:2.0:1789607967.319036:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607967.319042:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a6b expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.319056:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b800, rc 0) 00000100:00100000:2.0:1789607967.319125:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+16:14473:x1876539520176256:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 400us (731us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789607967.319133:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:3.0:1789607967.321860:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607967.322047:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520176512 00000100:00100000:1.0:1789607967.322062:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520176512 00000100:00100000:1.0:1789607967.322169:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:1.0:1789607967.322183:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+16:14473:x1876539520176512:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:1.0:1789607967.322875:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+17:14473:x1876539520176512:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 692us (1032us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789607967.322886:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 6 00000100:00100000:0.0:1789607967.383574:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607967.383725:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520176768 00000100:00100000:1.0:1789607967.383741:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520176768 00000100:00100000:1.0:1789607967.383832:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:1.0:1789607967.383843:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+17:14476:x1876539520176768:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:1.0:1789607967.383876:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607967.383905:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a72 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.384030:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013875bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.384047:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013875bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.384060:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013875bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607967.384073:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789607967.384272:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a72 expref: 20 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.384306:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013875bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a72 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.384315:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:1.0:1789607967.384319:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789607967.384323:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4efc00, rc 0) 00000100:00100000:1.0:1789607967.384396:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14476:x1876539520176768:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 554us (840us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789607967.384404:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:0.0:1789607967.393325:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607967.393472:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607967.393585:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520177024 00000100:00100000:3.0:1789607967.393599:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520177024 00000100:00100000:3.0:1789607967.393683:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:3.0:1789607967.393694:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:2375:x1876539520177024:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607967.393713:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607967.393741:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efc00/0x33f091d0013875bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a72 expref: 19 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607967.393764:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:3.0:1789607967.393771:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607967.393843:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:2375:x1876539520177024:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 150us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607967.393851:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:2.0:1789607967.394342:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520176896 00000100:00100000:2.0:1789607967.394350:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520176896 00000100:00100000:2.0:1789607967.394450:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:2.0:1789607967.394458:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:14476:x1876539520176896:12345-192.168.202.3@tcp:54:lfs.0 00010000:00010000:2.0:1789607967.394530:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875cd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.394547:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.394570:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.394606:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875cd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.394615:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875cd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.394644:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.394651:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607967.394656:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875cd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.394665:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875cd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.394677:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:2.0:1789607967.394680:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607967.394684:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875cd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.394691:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875cd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607967.394752:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:14476:x1876539520176896:12345-192.168.202.3@tcp:54:lfs.0 Request processed in 295us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607967.394759:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 32 00000100:00100000:0.0:1789607967.400181:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607967.400779:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520177280 00000100:00100000:2.0:1789607967.400794:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520177280 00000100:00100000:2.0:1789607967.400949:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:2.0:1789607967.400965:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:14476:x1876539520177280:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1789607967.401341:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14476:x1876539520177280:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 379us (1175us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789607967.404574:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 7 00000100:00100000:3.0:1789607967.714032:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607967.714391:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520177536 00000100:00100000:0.0:1789607967.714402:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520177536 00000100:00100000:0.0:1789607967.714495:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:0.0:1789607967.714518:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14507:x1876539520177536:12345-192.168.202.3@tcp:101:cat.0 00010000:00010000:0.0:1789607967.714541:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607967.714586:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d0013875d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a79 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607967.714693:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d0013875db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607967.714708:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d0013875db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607967.714719:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d0013875db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607967.714731:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789607967.714869:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2aca00/0x33f091d0013875d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a79 expref: 22 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607967.714889:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d0013875db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a79 expref: 21 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607967.714899:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:0.0:1789607967.714902:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607967.714906:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ad800, rc 0) 00000100:00100000:0.0:1789607967.714971:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+21:14507:x1876539520177536:12345-192.168.202.3@tcp:101:cat.0 Request processed in 466us (950us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1789607967.714979:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 33 00000100:00100000:0.0:1789607967.724417:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607967.724506:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607967.724677:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520177920 00000100:00100000:2.0:1789607967.724687:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520177920 00000100:00100000:2.0:1789607967.724754:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:2.0:1789607967.724764:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+21:14507:x1876539520177920:12345-192.168.202.3@tcp:35:cat.0 00000100:00100000:2.0:1789607967.725323:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+22:14507:x1876539520177920:12345-192.168.202.3@tcp:35:cat.0 Request processed in 560us (815us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789607967.725332:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 8 00000100:00100000:1.0:1789607967.725657:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520177664 00000100:00100000:1.0:1789607967.725663:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520177664 00000100:00100000:1.0:1789607967.725716:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 1 00000100:00100000:1.0:1789607967.725725:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+22:2374:x1876539520177664:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607967.725744:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607967.725768:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad800/0x33f091d0013875db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a79 expref: 22 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.725787:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:1.0:1789607967.725792:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607967.725815:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+21:2374:x1876539520177664:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 93us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607967.725821:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 1 00010000:00010000:0.0:1789607967.823030:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607967.844127:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607967.844649:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520178176 00000100:00100000:2.0:1789607967.844661:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520178176 00000100:00100000:2.0:1789607967.844719:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:2.0:1789607967.844730:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+21:14513:x1876539520178176:12345-192.168.202.3@tcp:101:dd.0 00010000:00010000:2.0:1789607967.844757:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607967.844778:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875e9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a80 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.845059:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013875f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.845074:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013875f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.845086:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013875f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607967.845097:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789607967.845395:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d0013875e9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a80 expref: 24 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.845416:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013875f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a80 expref: 23 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607967.845537:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:2.0:1789607967.845541:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607967.845544:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a400, rc 0) 00000100:00100000:2.0:1789607967.845634:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+23:14513:x1876539520178176:12345-192.168.202.3@tcp:101:dd.0 Request processed in 905us (1517us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789607967.845642:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 34 00000100:00100000:3.0:1789607967.849564:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607967.849681:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520178432 00000100:00100000:1.0:1789607967.849692:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520178432 00000100:00100000:1.0:1789607967.849752:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 35 00000100:00100000:1.0:1789607967.849775:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+23:14513:x1876539520178432:12345-192.168.202.3@tcp:36:dd.0 00010000:00010000:1.0:1789607967.849849:0:14430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789607967.849876:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d0013875f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a80 expref: 23 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.849898:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013875a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a64 expref: 22 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.849908:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:1.0:1789607967.849913:0:14430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607967.850109:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875fe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.850123:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.850135:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789607967.850187:0:14430:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1789607967.850212:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000896fb2e5 reply state 000000000628572e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607967.850221:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607967.850320:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+24:14513:x1876539520178432:12345-192.168.202.3@tcp:36:dd.0 Request processed in 546us (774us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789607967.850328:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 35 00000020:00080000:1.0:1789607967.850333:0:14430:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789607967.853848:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875fe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.853887:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875fe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.853896:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.853902:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607967.853907:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875fe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.853916:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875fe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.853933:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:1.0:1789607967.853936:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607967.853942:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875fe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607967.853948:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d0013875fe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607967.923931:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:3.0:1789607967.923948:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:3.0:1789607967.923964:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1789607967.966452:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607967.968490:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520178688 00000100:00100000:2.0:1789607967.968505:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520178688 00000100:00100000:2.0:1789607967.968590:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:2.0:1789607967.968601:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+10:14513:x1876539520178688:12345-192.168.202.3@tcp:35:dd.0 00000100:00100000:2.0:1789607967.968911:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+11:14513:x1876539520178688:12345-192.168.202.3@tcp:35:dd.0 Request processed in 311us (9111us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1789607967.968920:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 9 00000100:00100000:3.0:1789607968.326748:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607968.329057:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520178816 00000100:00100000:2.0:1789607968.329086:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520178816 00000100:00100000:2.0:1789607968.329196:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00100000:2.0:1789607968.329210:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+11:14527:x1876539520178816:12345-192.168.202.3@tcp:101:stat.0 00010000:00010000:2.0:1789607968.329245:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607968.329269:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387605 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a87 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329337:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d00138760c lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329354:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d00138760c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329395:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d00138760c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329412:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387613 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329420:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387613 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329472:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387613 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329786:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d00138761a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329796:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d00138761a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329804:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d00138761a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607968.329840:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789607968.329845:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607968.329886:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d00138761a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329897:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d00138761a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329905:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d00138760c lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329923:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d00138760c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329930:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d00138760c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329936:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103aa00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607968.329940:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d00138760c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329948:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d00138760c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329960:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a1c5961800) 00010000:00010000:2.0:1789607968.329963:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607968.329968:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d00138760c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329974:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d00138760c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329986:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387613 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329992:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387613 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.329997:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387613 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.330002:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607968.330010:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387613 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.330016:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387613 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.330023:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99a1c5961c00) 00010000:00010000:2.0:1789607968.330026:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607968.330029:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387613 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.330035:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387613 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.330069:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387605 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a87 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.330082:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d00138761a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a87 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.330089:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:2.0:1789607968.330091:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607968.330094:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103ac00, rc 0) 00000100:00100000:2.0:1789607968.330174:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+12:14527:x1876539520178816:12345-192.168.202.3@tcp:101:stat.0 Request processed in 968us (3442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607968.330183:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 36 00000100:00080000:0.0:1789607968.330759:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607968.395951:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541139072:0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.396023:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607968.396094:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876539541139584:0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.396134:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607968.396161:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789607968.396167:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3312:1876539541138944:0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.396195:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607968.396219:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541139456:0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.396240:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607968.396265:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541139200:0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.396287:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607968.396303:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789607968.396310:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541139328:0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.396330:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607968.396362:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541139072 00000100:00100000:2.0:1789607968.396369:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541139072 00000100:00100000:2.0:1789607968.396446:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541139200 00000100:00100000:2.0:1789607968.396449:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541139200 00000100:00100000:2.0:1789607968.396474:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789607968.396483:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541139072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.396863:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1876539541139072:12345-0@lo:400:kworker.0 Request processed in 380us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607968.396871:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789607968.396894:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607968.396901:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541139200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.396933:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541139200:12345-0@lo:400:kworker.0 Request processed in 33us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607968.396938:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789607968.396959:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541139584 00000100:00100000:2.0:1789607968.396971:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541139584 00000100:00100000:2.0:1789607968.396993:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541139456 00000100:00100000:2.0:1789607968.396996:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541139456 00000100:00100000:2.0:1789607968.397006:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541139328 00000100:00100000:2.0:1789607968.397009:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541139328 00000100:00100000:2.0:1789607968.397019:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607968.397024:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876539541139584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.397049:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1876539541139584:12345-0@lo:400:kworker.0 Request processed in 25us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607968.397055:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789607968.397078:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607968.397083:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541139456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.397104:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1876539541139456:12345-0@lo:400:kworker.0 Request processed in 22us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607968.397109:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789607968.397119:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789607968.397124:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541139328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.397146:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876539541139328:12345-0@lo:400:kworker.0 Request processed in 22us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607968.397152:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789607968.397171:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541138944 00000100:00100000:2.0:1789607968.397174:0:14426:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541138944 00000100:00100000:2.0:1789607968.397196:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789607968.397201:0:14426:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:3312:x1876539541138944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.397229:0:14426:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:3312:x1876539541138944:12345-0@lo:400:kworker.0 Request processed in 28us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607968.397235:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789607968.397299:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876539541139328:0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.397310:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541139200:0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.397337:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3312:1876539541138944:0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.397347:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1876539541139456:0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.397356:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1876539541139072:0@lo:400:kworker.0 00000100:00100000:2.0:1789607968.397363:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1876539541139584:0@lo:400:kworker.0 00000100:00080000:0.0:1789607968.398929:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789607968.398938:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607968.398941:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789607968.399347:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789607968.399366:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541139712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789607968.399451:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607968.401601:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541139712 00000100:00100000:3.0:1789607968.401615:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541139712 00000100:00100000:3.0:1789607968.401685:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607968.401695:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a201878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541139712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607968.401749:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789607968.401847:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a201878a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541139712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607968.401855:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789607968.401913:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541139712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607968.565994:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607968.566134:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520179072 00000100:00100000:2.0:1789607968.566154:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520179072 00000100:00100000:2.0:1789607968.566224:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 37 00000100:00100000:2.0:1789607968.566234:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+12:14533:x1876539520179072:12345-192.168.202.3@tcp:36:truncate.0 00010000:00010000:2.0:1789607968.566290:0:14433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789607968.566318:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d00138761a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a87 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.566337:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:2.0:1789607968.566343:0:14433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789607968.567040:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387621 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.567057:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387621 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.567068:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387621 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789607968.567123:0:14433:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1789607968.567181:0:14433:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd287dd4 reply state 00000000245559c5 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387621 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607968.567190:0:14433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607968.567325:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+14:14533:x1876539520179072:12345-192.168.202.3@tcp:36:truncate.0 Request processed in 1090us (1338us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1789607968.567332:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 37 00000020:00080000:2.0:1789607968.567338:0:14433:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789607968.575301:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387621 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607968.575320:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387621 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607968.575328:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387621 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607968.575351:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103b800 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607968.575356:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387621 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607968.575364:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387621 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607968.575381:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:1.0:1789607968.575384:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607968.575389:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387621 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607968.575395:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d001387621 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607968.843873:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607968.916295:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607968.917509:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520179200 00000100:00100000:2.0:1789607968.917522:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520179200 00000100:00100000:2.0:1789607968.917606:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:2.0:1789607968.917616:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+13:14547:x1876539520179200:12345-192.168.202.3@tcp:101:stat.0 00010000:00010000:2.0:1789607968.917639:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607968.917669:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387628 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a8e expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.917760:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138762f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.917776:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138762f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.917788:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138762f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.917802:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387636 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.917809:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.917827:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918103:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918112:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918120:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607968.918159:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1789607968.918163:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607968.918181:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918194:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918202:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138762f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918209:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138762f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918215:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138762f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918221:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103a200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607968.918226:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138762f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918241:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138762f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918255:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a1c5961800) 00010000:00010000:2.0:1789607968.918258:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607968.918264:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138762f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918270:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138762f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918283:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387636 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918289:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387636 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918295:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387636 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918300:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1d103aa00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:2.0:1789607968.918303:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387636 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918309:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387636 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918316:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99a1c5961c00) 00010000:00010000:2.0:1789607968.918318:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789607968.918321:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387636 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918338:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387636 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918373:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387628 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a8e expref: 15 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918387:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a8e expref: 14 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607968.918393:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:2.0:1789607968.918395:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789607968.918397:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b800, rc 0) 00000100:00100000:2.0:1789607968.918526:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+14:14547:x1876539520179200:12345-192.168.202.3@tcp:101:stat.0 Request processed in 911us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607968.918534:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 38 00000100:00100000:3.0:1789607969.095794:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.096089:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520179456 00000100:00100000:2.0:1789607969.096101:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520179456 00000100:00100000:2.0:1789607969.096166:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:2.0:1789607969.096176:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+14:14557:x1876539520179456:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607969.096198:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607969.096219:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387644 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a95 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607969.096305:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789607969.096462:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387644 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a95 expref: 16 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.096495:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c2fa2500) 00010000:00010000:2.0:1789607969.096498:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607969.096504:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387644 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a95 expref: 16 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.096518:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103ac00, rc 0) 00000100:00100000:2.0:1789607969.096596:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+15:14557:x1876539520179456:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 421us (812us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1789607969.096604:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 39 00000100:00100000:3.0:1789607969.105084:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.109467:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520179712 00000100:00100000:2.0:1789607969.109481:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520179712 00000100:00100000:2.0:1789607969.110198:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:2.0:1789607969.110213:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c2d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+15:14557:x1876539520179712:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1789607969.110916:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c2d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+16:14557:x1876539520179712:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 703us (5839us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789607969.110927:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 10 00000100:00100000:3.0:1789607969.227158:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607969.227615:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520179968 00000100:00100000:1.0:1789607969.227626:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520179968 00000100:00100000:1.0:1789607969.227738:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:1.0:1789607969.227750:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+16:14564:x1876539520179968:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:1.0:1789607969.227786:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789607969.227810:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387652 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9a9c expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.227926:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.227942:0:14430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b400/0x33f091d00138758e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a5d expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.227970:0:14430:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a8e expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.227978:0:14430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.228016:0:14430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a8e expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.228029:0:14430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a8e expref: 17 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607969.228042:0:14430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f55ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14430:1876539541139840:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607969.228144:0:14430:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b400/0x33f091d00138758e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a5d expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.228154:0:14430:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b400/0x33f091d00138758e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a5d expref: 17 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607969.228163:0:14430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f55a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14430:1876539541139968:192.168.202.3@tcp:104: 00000100:00100000:1.0:1789607969.228186:0:14430:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a0c2966900 going to sleep for 11 seconds 00000100:00100000:3.0:1789607969.232021:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607969.232060:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.232225:0:16548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520180096 00000100:00100000:0.0:1789607969.232234:0:16548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520180096 00010000:00010000:0.0:1789607969.232274:0:16548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a8e expref: 18 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607969.232315:0:16548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520180224 00000100:00100000:0.0:1789607969.232318:0:16548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520180224 00010000:00010000:0.0:1789607969.232331:0:16548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b400/0x33f091d00138758e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a5d expref: 19 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607969.232355:0:16548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1789607969.232365:0:16548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff532450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:2375:x1876539520180096:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607969.232381:0:16548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607969.232389:0:16548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a8e expref: 19 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.232403:0:16548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a8e expref: 19 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.232459:0:16548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:0.0:1789607969.232465:0:16548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.232475:0:16548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.232506:0:16548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607969.232570:0:16548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff532450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:2375:x1876539520180096:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 206us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607969.232578:0:16548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:0.0:1789607969.232629:0:16548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:0.0:1789607969.232635:0:16548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:2376:x1876539520180224:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607969.232643:0:16548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607969.232649:0:16548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b400/0x33f091d00138758e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a5d expref: 18 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.232659:0:16548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b400/0x33f091d00138758e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a5d expref: 18 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.232671:0:16548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:0.0:1789607969.232675:0:16548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.232684:0:16548:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.232692:0:16548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.232708:0:16548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607969.232725:0:16548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:2376:x1876539520180224:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 90us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607969.232732:0:16548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00010000:00010000:1.0:1789607969.233784:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b800/0x33f091d00138763d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a8e expref: 17 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607969.233806:0:14430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f55ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14430:1876539541139840:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607969.233848:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103b400/0x33f091d00138758e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a5d expref: 16 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607969.233860:0:14430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f55a8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14430:1876539541139968:192.168.202.3@tcp:104: 00010000:00010000:1.0:1789607969.233884:0:14430:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.233892:0:14430:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.233899:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789607969.233918:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1789607969.234077:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387652 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a9c expref: 17 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.234093:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a9c expref: 16 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.234101:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:1.0:1789607969.234103:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789607969.234107:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ff4ee200, rc 0) 00000100:00100000:1.0:1789607969.234164:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+16:14564:x1876539520179968:12345-192.168.202.3@tcp:101:bash.0 Request processed in 6417us (7016us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1789607969.234173:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 40 00000100:00100000:2.0:1789607969.240215:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.240286:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520180480 00000100:00100000:0.0:1789607969.240297:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520180480 00000100:00100000:0.0:1789607969.240352:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 41 00000100:00100000:0.0:1789607969.240361:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+16:14564:x1876539520180480:12345-192.168.202.3@tcp:36:bash.0 00010000:00010000:0.0:1789607969.240660:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001387667 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.240677:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001387667 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.240690:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001387667 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789607969.240758:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1789607969.240785:0:14432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf638ccf reply state 00000000d8287060 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001387667 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607969.240795:0:14432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789607969.240895:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14564:x1876539520180480:12345-192.168.202.3@tcp:36:bash.0 Request processed in 533us (686us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1789607969.240902:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 41 00000020:00080000:0.0:1789607969.240908:0:14432:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789607969.248363:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607969.248765:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520180608 00000100:00100000:3.0:1789607969.248784:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520180608 00000100:00100000:3.0:1789607969.248858:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 42 00000100:00100000:3.0:1789607969.248870:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14564:x1876539520180608:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:3.0:1789607969.248892:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607969.248913:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138766e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9aa3 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.248973:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138766e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9aa3 expref: 20 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.248987:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138766e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9aa3 expref: 20 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.249008:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:3.0:1789607969.249020:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789607969.249026:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1511200, rc 0) 00000100:00100000:3.0:1789607969.249092:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+20:14564:x1876539520180608:12345-192.168.202.3@tcp:101:bash.0 Request processed in 225us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607969.249098:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 42 00010000:00010000:1.0:1789607969.252358:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001387667 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.252398:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001387667 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.252406:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001387667 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.252412:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ad000 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607969.252417:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001387667 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.252440:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001387667 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.252459:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:1.0:1789607969.252462:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607969.252467:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001387667 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.252473:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad000/0x33f091d001387667 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607969.259969:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.260117:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520180736 00000100:00100000:2.0:1789607969.260137:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520180736 00000100:00100000:2.0:1789607969.260196:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:2.0:1789607969.260205:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14564:x1876539520180736:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607969.260226:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607969.260246:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387675 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9aaa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.260335:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138767c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.260348:0:14433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a9c expref: 20 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.260358:0:14433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138767c lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.260388:0:14433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a9c expref: 20 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.260401:0:14433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a9c expref: 20 pid: 14430 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607969.260414:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e4f4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14433:1876539541140096:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607969.260528:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f92ec600 going to sleep for 11 seconds 00000100:00100000:2.0:1789607969.265677:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607969.265897:0:16548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520180864 00000100:00100000:1.0:1789607969.265906:0:16548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520180864 00010000:00010000:1.0:1789607969.265946:0:16548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a9c expref: 21 pid: 14430 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607969.265993:0:16548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1789607969.266004:0:16548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+21:2373:x1876539520180864:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607969.266019:0:16548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607969.266040:0:16548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a9c expref: 21 pid: 14430 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.266053:0:16548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a9c expref: 21 pid: 14430 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.266074:0:16548:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:1.0:1789607969.266080:0:16548:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138767c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.266090:0:16548:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138767c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.266097:0:16548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138767c lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.266115:0:16548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607969.266172:0:16548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+21:2373:x1876539520180864:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 169us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607969.266180:0:16548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00010000:00010000:0.0:1789607969.266319:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ee200/0x33f091d001387659 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9a9c expref: 20 pid: 14430 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607969.266339:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e4f4c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14433:1876539541140096:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607969.266362:0:14433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138767c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.266371:0:14433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138767c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.266385:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138767c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607969.266482:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789607969.266487:0:14433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789607969.266508:0:14433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138767c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.266565:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d001387675 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9aaa expref: 20 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.266581:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138767c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9aaa expref: 19 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.266589:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:0.0:1789607969.266592:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789607969.266595:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a200, rc 0) 00000100:00100000:0.0:1789607969.266619:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14564:x1876539520180736:12345-192.168.202.3@tcp:101:bash.0 Request processed in 6416us (6660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607969.266627:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 43 00000100:00100000:0.0:1789607969.271068:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607969.271212:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520181120 00000100:00100000:3.0:1789607969.271222:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520181120 00000100:00100000:3.0:1789607969.271296:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:3.0:1789607969.271307:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14564:x1876539520181120:12345-192.168.202.3@tcp:103:bash.0 00010000:00010000:3.0:1789607969.271322:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789607969.271349:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d00138767c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9aaa expref: 19 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.271373:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d00138766e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9aa3 expref: 18 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.271384:0:14416:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1c5961400) 00010000:00010000:3.0:1789607969.271396:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607969.271491:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+17:14564:x1876539520181120:12345-192.168.202.3@tcp:103:bash.0 Request processed in 186us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607969.271499:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 2 00000100:00100000:3.0:1789607969.275639:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.276474:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520181248 00000100:00100000:0.0:1789607969.276485:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520181248 00000100:00100000:0.0:1789607969.276555:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:0.0:1789607969.276565:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+17:14564:x1876539520181248:12345-192.168.202.3@tcp:58:bash.0 00010000:00010000:0.0:1789607969.276680:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001387683 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.276717:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001387683 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.276729:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001387683 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789607969.277812:0:14432:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789607969.281902:0:14432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789607969.282005:0:14432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789607969.282147:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+17:14564:x1876539520181248:12345-192.168.202.3@tcp:58:bash.0 Request processed in 5578us (6512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607969.282160:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 44 00000100:00100000:0.0:1789607969.287699:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.288110:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520181376 00000100:00100000:2.0:1789607969.288122:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520181376 00000100:00100000:2.0:1789607969.288190:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 45 00000100:00100000:2.0:1789607969.288200:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+17:14564:x1876539520181376:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607969.288221:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607969.288242:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138768a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9ab1 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.288296:0:14433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001387683 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.288322:0:14433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138768a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ab1 expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.288340:0:14433:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001387683 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.288353:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138768a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ab1 expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.288366:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:2.0:1789607969.288369:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607969.288373:0:14433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138768a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ab1 expref: 18 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.288381:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a400, rc 0) 00000100:00100000:2.0:1789607969.288485:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:14564:x1876539520181376:12345-192.168.202.3@tcp:101:bash.0 Request processed in 286us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607969.288493:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 45 00000040:00080000:3.0:1789607969.291712:0:14465:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789607969.291736:0:14465:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789607969.291794:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789607969.291801:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789607969.292849:0:14465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1c8d2fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14465:1876539541140224:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789607969.292958:0:14465:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1e8ffd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789607969.307900:0:14465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1c8d2fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14465:1876539541140224:192.168.202.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789607969.322337:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.322486:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520181504 00000100:00100000:2.0:1789607969.322496:0:14442:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520181504 00000100:00100000:2.0:1789607969.322573:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:2.0:1789607969.322584:0:14442:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:14565:x1876539520181504:12345-192.168.202.3@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789607969.322689:0:14442:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:14565:x1876539520181504:12345-192.168.202.3@tcp:900:lhsmtool_posix.0 Request processed in 106us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607969.322697:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:3.0:1789607969.329986:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.330775:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520181632 00000100:00100000:2.0:1789607969.330801:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520181632 00000100:00100000:2.0:1789607969.330872:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:2.0:1789607969.330883:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:14565:x1876539520181632:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789607969.330919:0:14432:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789607969.331031:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:14565:x1876539520181632:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 150us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607969.331039:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 46 00000100:00100000:0.0:1789607969.337213:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607969.337339:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520181760 00000100:00100000:3.0:1789607969.337348:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520181760 00000100:00100000:3.0:1789607969.337414:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:3.0:1789607969.337460:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:14565:x1876539520181760:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789607969.337532:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d001387691 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.337561:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d001387691 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.337573:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d001387691 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.337631:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387698 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.337640:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387698 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.337647:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387698 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.337671:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d00138769f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.337679:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d00138769f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.337706:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d00138769f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789607969.337746:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789607969.337751:0:14430:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789607969.337767:0:14430:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d00138769f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.337972:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d001387691 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.337979:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d001387691 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.337987:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d001387691 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.337993:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1511200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607969.337997:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d001387691 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338005:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d001387691 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338017:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1c2fa2d00) 00010000:00010000:3.0:1789607969.338020:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607969.338025:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d001387691 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338041:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d001387691 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338068:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387698 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338075:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387698 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338082:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387698 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338088:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1510200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607969.338091:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387698 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338098:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387698 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338106:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff99a1c3982000) 00010000:00010000:3.0:1789607969.338109:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607969.338112:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387698 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338118:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d001387698 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338134:0:14430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d00138769f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338141:0:14430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d00138769f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338147:0:14430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d00138769f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338157:0:14430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1511e00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:3.0:1789607969.338160:0:14430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d00138769f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338167:0:14430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d00138769f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338175:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:3.0:1789607969.338177:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789607969.338180:0:14430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d00138769f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.338186:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d00138769f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607969.338261:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:14565:x1876539520181760:12345-192.168.202.3@tcp:34:lhsmtool_posix.0 Request processed in 837us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607969.338269:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 47 00000100:00100000:3.0:1789607969.342272:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.342828:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520182016 00000100:00100000:0.0:1789607969.342840:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520182016 00000100:00100000:0.0:1789607969.342910:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:0.0:1789607969.342920:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+18:14565:x1876539520182016:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607969.342939:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607969.342960:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9ab8 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.343058:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.343074:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.343106:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789607969.343119:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789607969.343217:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.343226:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876ad lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.343232:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.343237:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607969.343242:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.343250:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876ad lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.343262:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:0.0:1789607969.343265:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789607969.343271:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876ad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.343277:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.343323:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876a6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ab8 expref: 20 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.343345:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a1c2fa2d00) 00010000:00010000:0.0:1789607969.343348:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789607969.343352:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ab8 expref: 20 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.343362:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ad400, rc 0) 00000100:00100000:0.0:1789607969.343472:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14565:x1876539520182016:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 554us (1211us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1789607969.343479:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 48 00000100:00100000:0.0:1789607969.355310:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.355517:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520182144 00000100:00100000:2.0:1789607969.355528:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520182144 00000100:00100000:2.0:1789607969.355667:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:2.0:1789607969.355681:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14565:x1876539520182144:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789607969.355718:0:14432:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789607969.356120:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14565:x1876539520182144:12345-192.168.202.3@tcp:53:lhsmtool_posix.0 Request processed in 442us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607969.356129:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 49 00000100:00100000:2.0:1789607969.372595:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607969.372725:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520182400 00000100:00100000:3.0:1789607969.372735:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520182400 00000100:00100000:3.0:1789607969.372808:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:3.0:1789607969.372826:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e4f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14565:x1876539520182400:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789607969.372848:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789607969.372870:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d0013876bb lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9abf expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789607969.373795:0:14430:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:3.0:1789607969.373811:0:14430:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1789607969.373862:0:14430:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1789607969.374145:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d0013876c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.374162:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d0013876c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.374175:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d0013876c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.374235:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511e00/0x33f091d0013876bb lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9abf expref: 22 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.374254:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d0013876c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9abf expref: 21 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.374263:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a1c3982000) 00010000:00010000:3.0:1789607969.374266:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789607969.374270:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1c1510200, rc 0) 00000100:00100000:3.0:1789607969.374354:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e4f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+21:14565:x1876539520182400:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 1529us (1768us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1789607969.374362:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 50 00000100:00100000:2.0:1789607969.381066:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.381182:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520182656 00000100:00100000:0.0:1789607969.381193:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520182656 00000100:00100000:0.0:1789607969.381269:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:0.0:1789607969.381279:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+21:14565:x1876539520182656:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789607969.381340:0:14432:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607969.381367:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510200/0x33f091d0013876c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9abf expref: 21 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381387:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a1c3982000) 00010000:00010000:0.0:1789607969.381399:0:14432:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789607969.381465:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876d0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381488:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381498:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381546:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876d7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5d35816e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381554:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d35816e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381568:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d35816e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381795:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876d0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381803:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876d0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381809:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876d0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381816:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ad400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607969.381820:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876d0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381828:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876d0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381836:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a1c5961800) 00010000:00010000:0.0:1789607969.381839:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607969.381843:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876d0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381850:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad400/0x33f091d0013876d0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381867:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876d7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d35816e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381873:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876d7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d35816e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381878:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d35816e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381883:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607969.381886:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876d7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d35816e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381891:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876d7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x5d35816e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381898:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x5d35816e (ffff99a1f911de00) 00010000:00010000:0.0:1789607969.381901:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607969.381903:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876d7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5d35816e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.381909:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac400/0x33f091d0013876d7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x5d35816e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607969.381985:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+20:14565:x1876539520182656:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 707us (928us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789607969.381992:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 51 00000100:00100000:3.0:1789607969.386471:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.386579:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520182784 00000100:00100000:0.0:1789607969.386590:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520182784 00000100:00100000:0.0:1789607969.386641:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:0.0:1789607969.386666:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+20:14565:x1876539520182784:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607969.386688:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607969.386712:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d0013876de lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9ac6 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.386749:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2adc00/0x33f091d0013876e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.386762:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2adc00/0x33f091d0013876e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.386774:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2adc00/0x33f091d0013876e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.386883:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac800/0x33f091d0013876de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ac6 expref: 22 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.386902:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2adc00/0x33f091d0013876e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ac6 expref: 21 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.386911:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a1f911dc00) 00010000:00010000:0.0:1789607969.386914:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789607969.386918:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2adc00, rc 0) 00000100:00100000:0.0:1789607969.386982:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+21:14565:x1876539520182784:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 318us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607969.386990:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 52 00000100:00100000:2.0:1789607969.391400:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607969.391871:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520183040 00000100:00100000:3.0:1789607969.391882:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520183040 00000100:00100000:3.0:1789607969.391949:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:3.0:1789607969.391959:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+21:14565:x1876539520183040:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789607969.392070:0:14430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d0013876ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.392096:0:14430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d0013876ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.392110:0:14430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d0013876ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789607969.393289:0:14430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1789607969.393305:0:14430:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 503237881758ns, next at 504237878302ns, rc = 0 00000004:00010000:2.0:1789607969.393400:0:14430:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073fc1143 reply state 000000007162798c transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d0013876ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607969.393411:0:14430:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789607969.393927:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+23:14565:x1876539520183040:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 1965us (2532us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1789607969.393936:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 53 00000100:00100000:3.0:1789607969.398460:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00010000:00010000:1.0:1789607969.398809:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d0013876ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.398823:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d0013876ec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.398831:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d0013876ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.398837:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1511200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607969.398841:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d0013876ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.398864:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d0013876ec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.398881:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a1f911dc00) 00010000:00010000:1.0:1789607969.398884:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789607969.398890:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d0013876ec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.398896:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511200/0x33f091d0013876ec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14430 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607969.399192:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520183168 00000100:00100000:2.0:1789607969.399202:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520183168 00000100:00100000:2.0:1789607969.399361:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00100000:2.0:1789607969.399372:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+22:14565:x1876539520183168:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607969.399395:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607969.399414:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013876f3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9acd expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.399735:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013876f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9acd expref: 23 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.399749:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013876f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9acd expref: 23 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.399766:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a1f911dc00) 00010000:00010000:2.0:1789607969.399769:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789607969.399771:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a600, rc 0) 00000100:00100000:2.0:1789607969.399910:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+23:14565:x1876539520183168:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 539us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607969.399917:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 54 00000100:00100000:3.0:1789607969.404174:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.404472:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520183296 00000100:00100000:0.0:1789607969.404492:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520183296 00000100:00080000:1.0:1789607969.404766:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789607969.404876:0:16421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:0.0:1789607969.404904:0:16421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2374:x1876539520183296:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789607969.405825:0:16421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:2374:x1876539520183296:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 916us (1655us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789607969.405836:0:16421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:3.0:1789607969.413104:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607969.421683:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520183552 00000100:00100000:1.0:1789607969.421701:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520183552 00000100:00100000:2.0:1789607969.421874:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:2.0:1789607969.421884:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+23:14565:x1876539520183552:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789607969.422128:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+24:14565:x1876539520183552:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 244us (9033us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789607969.422135:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 11 00000100:00100000:2.0:1789607969.428943:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607969.429500:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520183808 00000100:00100000:1.0:1789607969.429511:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520183808 00000100:00100000:1.0:1789607969.429931:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:1.0:1789607969.429943:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+24:14565:x1876539520183808:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789607969.430214:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+24:14565:x1876539520183808:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 273us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607969.430232:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 55 00000100:00100000:3.0:1789607969.434552:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.435119:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520183936 00000100:00100000:2.0:1789607969.435130:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520183936 00000100:00100000:2.0:1789607969.435197:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 56 00000100:00100000:2.0:1789607969.435208:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+24:14565:x1876539520183936:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607969.435304:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607969.435331:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d0013876fa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9ad4 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.435414:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387701 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.436326:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.436341:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607969.436383:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789607969.436405:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.436456:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103aa00/0x33f091d0013876fa lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ad4 expref: 26 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.436489:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387701 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ad4 expref: 25 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.436499:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a1f911dc00) 00010000:00010000:2.0:1789607969.436501:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789607969.436505:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103ac00, rc 0) 00000100:00100000:2.0:1789607969.437339:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+25:14565:x1876539520183936:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 2127us (2800us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607969.437348:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 56 00000100:00100000:2.0:1789607969.451276:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.451467:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520184064 00000100:00100000:0.0:1789607969.451479:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520184064 00000100:00100000:0.0:1789607969.451559:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:0.0:1789607969.451570:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:2374:x1876539520184064:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789607969.451592:0:15117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789607969.451617:0:15117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008fc2e7b/0x33f091d001387708 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9adb expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789607969.451645:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aab4021, blocks: 0x1 00010000:00010000:0.0:1789607969.451667:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=503s v=(0 0) 00010000:00010000:0.0:1789607969.451672:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607969.451682:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008fc2e7b/0x33f091d001387708 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9adb expref: 7 pid: 15117 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.451702:0:15117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008fc2e7b/0x33f091d001387708 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9adb expref: 7 pid: 15117 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.451717:0:15117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1ee2ac400, rc 0) 00000100:00100000:0.0:1789607969.451794:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:2374:x1876539520184064:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 226us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607969.451802:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:0.0:1789607969.460074:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607969.460157:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520184320 00000100:00100000:1.0:1789607969.460168:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520184320 00000100:00100000:1.0:1789607969.460236:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:1.0:1789607969.460248:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+25:14565:x1876539520184320:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789607969.460404:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+25:14565:x1876539520184320:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 157us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607969.460458:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 57 00000100:00100000:3.0:1789607969.479935:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.480071:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520184448 00000100:00100000:2.0:1789607969.480081:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520184448 00000100:00100000:2.0:1789607969.480157:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:2.0:1789607969.480168:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1c8d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+25:14565:x1876539520184448:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789607969.601419:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934619 is committed 00000001:00080000:1.0:1789607969.601468:0:5869:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:1.0:1789607969.601496:0:5869:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789607969.601678:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1f55a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541140352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789607969.601746:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607969.602129:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1c8d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+13:14565:x1876539520184448:12345-192.168.202.3@tcp:44:lhsmtool_posix.0 Request processed in 121960us (122200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607969.602141:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 58 00000100:00100000:1.0:1789607969.602811:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541140352 00000100:00100000:1.0:1789607969.602820:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541140352 00000100:00100000:1.0:1789607969.602862:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789607969.602871:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1876539541140352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789607969.603030:0:15115:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789607969.603034:0:15115:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789607969.603036:0:15115:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789607969.603038:0:15115:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789607969 -> 1789607969 00002000:00010000:1.0:1789607969.603041:0:15115:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789607969.603086:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1876539541140352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 217us (1341us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789607969.603093:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1789607969.603139:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a1f55a8380/2, rc 0, transno 8589934595 00000100:00100000:1.0:1789607969.603145:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1f55a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1876539541140352:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789607969.604607:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607969.606015:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520184576 00000100:00100000:1.0:1789607969.606028:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520184576 00000100:00100000:1.0:1789607969.606095:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:1.0:1789607969.606105:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:2373:x1876539520184576:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789607969.606228:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200cef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:2373:x1876539520184576:12345-192.168.202.3@tcp:16:lhsmtool_posix.0 Request processed in 125us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607969.606248:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:3.0:1789607969.609480:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607969.611584:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520184832 00000100:00100000:1.0:1789607969.611598:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520184832 00000100:00100000:1.0:1789607969.611681:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:1.0:1789607969.611692:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+13:14565:x1876539520184832:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789607969.611746:0:14433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607969.611773:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103ac00/0x33f091d001387701 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ad4 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.611808:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a1f911dc00) 00010000:00010000:1.0:1789607969.611812:0:14433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789607969.611844:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d00138770f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.611858:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d00138770f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.611867:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d00138770f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789607969.612056:0:14433:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000898e4bcd reply state 00000000d36ff20d transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d00138770f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607969.612065:0:14433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789607969.612174:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200cee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+14:14565:x1876539520184832:12345-192.168.202.3@tcp:36:lhsmtool_posix.0 Request processed in 482us (2703us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1789607969.612181:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 59 00000100:00100000:3.0:1789607969.615146:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.618729:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520184960 00000100:00100000:2.0:1789607969.618745:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520184960 00000100:00100000:2.0:1789607969.618822:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:2.0:1789607969.618833:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:14565:x1876539520184960:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789607969.618849:0:15115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607969.618868:0:15115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9ae2 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.618901:0:15115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008fc2e7b/0x33f091d001387708 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9adb expref: 8 pid: 15117 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.618911:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607969.618916:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607969.618921:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae2 expref: 8 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.618969:0:15115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008fc2e7b/0x33f091d001387708 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9adb expref: 8 pid: 15117 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.619003:0:15115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008fc2e7b/0x33f091d001387708 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9adb expref: 8 pid: 15117 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607969.619018:0:15115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15115:1876539541140480:192.168.202.3@tcp:104: 00000100:00100000:2.0:1789607969.619118:0:15115:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1f5119b40 going to sleep for 11 seconds 00010000:00010000:1.0:1789607969.620462:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d00138770f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.620502:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d00138770f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.620509:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d00138770f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.620514:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4efa00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:1.0:1789607969.620727:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d00138770f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.620737:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d00138770f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.620755:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a1f911dc00) 00010000:00010000:1.0:1789607969.620758:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789607969.620763:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d00138770f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.620769:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4efa00/0x33f091d00138770f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607969.624397:0:15115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff4ac700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15115:1876539541140480:192.168.202.3@tcp:104: 00010000:00010000:2.0:1789607969.624481:0:15115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae2 expref: 8 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.624501:0:15115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103aa00, rc 0) 00000100:00100000:2.0:1789607969.624575:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200cef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+8:14565:x1876539520184960:12345-192.168.202.3@tcp:101:lhsmtool_posix.0 Request processed in 5743us (9439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607969.624585:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 17 00000100:00100000:1.0:1789607969.629678:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.629918:0:16548:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520185088 00000100:00100000:0.0:1789607969.629928:0:16548:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520185088 00010000:00010000:0.0:1789607969.629989:0:16548:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008fc2e7b/0x33f091d001387708 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9adb expref: 8 pid: 15117 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607969.630032:0:16548:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:0.0:1789607969.630042:0:16548:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+8:2374:x1876539520185088:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789607969.630057:0:16548:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789607969.630081:0:16548:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008fc2e7b/0x33f091d001387708 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9adb expref: 8 pid: 15117 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.630095:0:16548:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008fc2e7b/0x33f091d001387708 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9adb expref: 8 pid: 15117 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.630121:0:16548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008fc2e7b/0x33f091d001387708 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9adb expref: 8 pid: 15117 timeout: 603 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.630138:0:16548:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607969.630142:0:16548:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789607969.630149:0:16548:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae2 expref: 7 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.630158:0:16548:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae2 expref: 7 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.630216:0:16548:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae2 expref: 7 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607969.630243:0:16548:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff418380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16548:1876539541140608:192.168.202.3@tcp:105: 00000100:00100000:0.0:1789607969.630333:0:16548:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a1c8e7fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789607969.638802:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.638828:0:16548:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff418380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16548:1876539541140608:192.168.202.3@tcp:105: 00010000:00010000:0.0:1789607969.638854:0:16548:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789607969.638919:0:16548:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:2374:x1876539520185088:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 8877us (9250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607969.638930:0:16548:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:1.0:1789607969.639940:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520185216 00000100:00100000:1.0:1789607969.639960:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520185216 00000100:00100000:1.0:1789607969.640007:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:1.0:1789607969.640016:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:2374:x1876539520185216:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789607969.640206:0:15117:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789607969.640210:0:15117:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789607969 00002000:00010000:1.0:1789607969.640213:0:15117:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789607967 00002000:00010000:1.0:1789607969.640241:0:15117:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789607969 -> 1789607969 00002000:00010000:1.0:1789607969.640243:0:15117:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789607969.640298:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200cece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+8:2374:x1876539520185216:12345-192.168.202.3@tcp:2:lhsmtool_posix.0 Request processed in 283us (1505us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789607969.640306:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 18 00000100:00100000:3.0:1789607969.644264:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.644371:0:16421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520185344 00000100:00100000:0.0:1789607969.644380:0:16421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520185344 00000100:00100000:2.0:1789607969.644612:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:3.0:1789607969.644720:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+8:2373:x1876539520185344:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789607969.644769:0:15115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.644789:0:15115:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae2 expref: 8 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.644817:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789607969.644821:0:15115:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607969.644826:0:15115:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.644862:0:15115:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae2 expref: 8 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.644876:0:15115:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae2 expref: 8 pid: 15115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607969.644889:0:15115:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a200cee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15115:1876539541140736:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607969.645062:0:15115:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a200ceb300 going to sleep for 11 seconds 00000100:00100000:3.0:1789607969.651648:0:15115:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a200cee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15115:1876539541140736:192.168.202.3@tcp:104: 00010000:00010000:3.0:1789607969.651682:0:15115:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789607969.656000:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607969.656380:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520185472 00000100:00100000:3.0:1789607969.656391:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520185472 00010000:00010000:3.0:1789607969.656462:0:14416:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae2 expref: 9 pid: 15115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607969.656518:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:3.0:1789607969.656771:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff4ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+9:2374:x1876539520185472:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789607969.656802:0:14416:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789607969.656828:0:14416:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae2 expref: 9 pid: 15115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.656842:0:14416:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae2 expref: 9 pid: 15115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.656871:0:14416:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035d8fa89/0x33f091d001387716 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae2 expref: 9 pid: 15115 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.656892:0:14416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607969.656898:0:14416:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789607969.656904:0:14416:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.656916:0:14416:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.656964:0:14416:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789607969.657035:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff4ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+8:2374:x1876539520185472:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 270us (1045us total) trans 0 rc 0/0 00010000:00010000:1.0:1789607969.657096:0:15115:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.657107:0:15115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.657132:0:15115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.657141:0:15115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.657150:0:15115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.657157:0:15115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1511e00 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:1.0:1789607969.657161:0:15115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.657170:0:15115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.657195:0:15115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.657204:0:15115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000696bb52f/0x33f091d00138771d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607969.657265:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200cedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+8:2373:x1876539520185344:12345-192.168.202.3@tcp:1:lhsmtool_posix.0 Request processed in 12642us (13010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607969.657272:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 19 00000100:00100000:3.0:1789607969.657727:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:1.0:1789607969.661341:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:3.0:1789607969.661694:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520185728 00000100:00100000:3.0:1789607969.661705:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520185728 00000100:00100000:3.0:1789607969.661770:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 60 00000100:00100000:3.0:1789607969.661780:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1f55ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+13:14565:x1876539520185728:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789607969.661884:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387724 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.661901:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387724 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.661913:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387724 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.662159:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.662172:0:14432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013876f3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9acd expref: 14 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.662180:0:14432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.662213:0:14432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013876f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9acd expref: 14 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.662242:0:14432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013876f3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9acd expref: 14 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789607969.662255:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a200cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14432:1876539541140864:192.168.202.3@tcp:104: 00000100:00100000:3.0:1789607969.662470:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a200ceb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789607969.668368:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.668460:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520185856 00000100:00100000:0.0:1789607969.668467:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520185856 00000100:00100000:3.0:1789607969.668475:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a200cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14432:1876539541140864:192.168.202.3@tcp:104: 00010000:00010000:0.0:1789607969.668507:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013876f3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9acd expref: 15 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789607969.668571:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 16 00000100:00100000:1.0:1789607969.668583:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+15:2374:x1876539520185856:12345-192.168.202.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789607969.668599:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789607969.668608:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013876f3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9acd expref: 15 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.668621:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013876f3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9acd expref: 15 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.668643:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a600/0x33f091d0013876f3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9acd expref: 15 pid: 14432 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.668658:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a1f911dc00) 00010000:00010000:1.0:1789607969.668663:0:14417:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.668687:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.668694:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.668713:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789607969.668767:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+14:2374:x1876539520185856:12345-192.168.202.3@tcp:103:ldlm_bl.0 Request processed in 186us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607969.668774:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 16 00010000:00010000:3.0:1789607969.670143:0:14432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.670171:0:14432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789607969.670178:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789607969.670394:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1789607969.670814:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1789607969.670864:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1789607969.670951:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a200cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14432:1876539541140992:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789607969.671066:0:14432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607969.671175:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a200ceb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607969.671301:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541140992 00000100:00100000:2.0:1789607969.671309:0:14436:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541140992 00000100:00100000:2.0:1789607969.671393:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789607969.671403:0:14436:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14432:x1876539541140992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789607969.671574:0:14436:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200ced880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14432:x1876539541140992:12345-0@lo:1000:mdt00_001.0 Request processed in 172us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607969.671582:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789607969.671858:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a200cee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14432:1876539541140992:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789607969.672448:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1789607969.672514:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff418380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14432:1876539541141120:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789607969.672577:0:14432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607969.672610:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a200c4c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789607969.672658:0:14437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541141120 00000100:00100000:1.0:1789607969.672664:0:14437:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541141120 00000100:00100000:1.0:1789607969.672704:0:14437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789607969.672713:0:14437:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14432:x1876539541141120:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789607969.672941:0:14437:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14432:x1876539541141120:12345-0@lo:1000:mdt00_001.0 Request processed in 228us (362us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789607969.672949:0:14437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789607969.673062:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff418380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14432:1876539541141120:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789607969.673094:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673112:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673120:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673127:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1511400 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607969.673132:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673140:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673156:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a1f911dc00) 00010000:00010000:0.0:1789607969.673159:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607969.673165:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673171:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1511400/0x33f091d00138772b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673205:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001387683 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673211:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001387683 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673217:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001387683 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673235:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607969.673246:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001387683 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673253:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001387683 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673261:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:0.0:1789607969.673263:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789607969.673269:0:14432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138768a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ab1 expref: 17 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673281:0:14432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138768a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ab1 expref: 17 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673290:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138768a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ab1 expref: 17 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.673338:0:14432:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a400/0x33f091d00138768a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ab1 expref: 17 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607969.673350:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1ff418000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14432:1876539541141248:192.168.202.3@tcp:105: 00000100:00100000:0.0:1789607969.673689:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff99a200c4c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789607969.686525:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.686672:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1ff418000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14432:1876539541141248:192.168.202.3@tcp:105: 00010000:00010000:0.0:1789607969.686705:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001387683 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686717:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d001387683 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686769:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387732 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686783:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387732 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686795:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387732 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686806:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387732 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686812:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387732 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686818:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387732 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686824:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ad600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607969.686829:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387732 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686836:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387732 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686848:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:0.0:1789607969.686851:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607969.686855:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387732 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686861:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387732 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686878:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387724 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686884:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387724 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686890:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387724 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686895:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1c1510a00 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607969.686897:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387724 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686903:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387724 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686910:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:0.0:1789607969.686913:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789607969.686916:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387724 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.686921:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1c1510a00/0x33f091d001387724 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607969.687236:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1f55ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+17:14565:x1876539520185728:12345-192.168.202.3@tcp:57:lhsmtool_posix.0 Request processed in 25455us (25902us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1789607969.687246:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 60 00000020:00080000:0.0:1789607969.687254:0:14432:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789607969.687543:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520185984 00000100:00100000:1.0:1789607969.687550:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520185984 00000100:00100000:1.0:1789607969.687597:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:1.0:1789607969.687607:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+17:14564:x1876539520185984:12345-192.168.202.3@tcp:49:bash.0 00000100:00100000:1.0:1789607969.687710:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+17:14564:x1876539520185984:12345-192.168.202.3@tcp:49:bash.0 Request processed in 104us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789607969.687717:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 12 00000100:00100000:3.0:1789607969.691168:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607969.691334:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520186240 00000100:00100000:1.0:1789607969.691346:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520186240 00000100:00100000:1.0:1789607969.691402:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 13 00000100:00100000:1.0:1789607969.691465:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+17:14565:x1876539520186240:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1789607969.692897:0:14465:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789607969.692905:0:14465:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789607969.692935:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789607969.692943:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000004:00080000:1.0:1789607969.693618:0:14435:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789607969.693748:0:14435:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:1.0:1789607969.693807:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387739 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.693826:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387739 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.693838:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387739 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.693847:0:14435:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387739 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.693853:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387739 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.693859:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387739 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.693925:0:14435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789607969.694044:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200ceca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14565:x1876539520186240:12345-192.168.202.3@tcp:35:lhsmtool_posix.0 Request processed in 2617us (2884us total) trans 8589934630 rc 0/0 00000100:00100000:1.0:1789607969.694054:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 13 00000020:00080000:1.0:1789607969.694060:0:14435:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789607969.696636:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.697199:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520186368 00000100:00100000:2.0:1789607969.697210:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520186368 00000100:00100000:2.0:1789607969.697282:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:2.0:1789607969.697292:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+7:14564:x1876539520186368:12345-192.168.202.3@tcp:101:bash.0 00010000:00010000:2.0:1789607969.697311:0:15117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607969.697333:0:15117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387740 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9ae9 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789607969.697361:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aab4021, atime: 0x6aab401f, ctime: 0x6aab4021, blocks: 0x1 00010000:00010000:2.0:1789607969.697387:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=503s v=(0 0) 00010000:00010000:2.0:1789607969.697392:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789607969.697403:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387740 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae9 expref: 8 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.697458:0:15117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000af43bf6d/0x33f091d001387740 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9ae9 expref: 8 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.697472:0:15117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103b400, rc 0) 00000100:00100000:2.0:1789607969.697780:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+8:14564:x1876539520186368:12345-192.168.202.3@tcp:101:bash.0 Request processed in 488us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607969.697787:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00010000:00010000:0.0:1789607969.702462:0:14419:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789607969.702486:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387739 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.702514:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ff4ef600 already unused, calling callback (ffffffffc14f68b0) 00010000:00010000:0.0:1789607969.702526:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387739 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.702545:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387739 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.702567:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a1f911dc00) 00010000:00010000:0.0:1789607969.702570:0:14419:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789607969.702576:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387739 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.702581:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ff4ef600/0x33f091d001387739 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789607969.702810:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607969.702813:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607969.702815:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789607969.703321:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607969.704087:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520186624 00000100:00100000:1.0:1789607969.704110:0:14434:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520186624 00000100:00100000:1.0:1789607969.704163:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 14 00000100:00100000:1.0:1789607969.704173:0:14434:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+19:14564:x1876539520186624:12345-192.168.202.3@tcp:35:bash.0 00000001:00080000:1.0:1789607969.704859:0:14434:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:1.0:1789607969.705207:0:14434:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200cec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+21:14564:x1876539520186624:12345-192.168.202.3@tcp:35:bash.0 Request processed in 1032us (1887us total) trans 8589934632 rc 0/0 00000100:00100000:1.0:1789607969.705226:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 14 00000020:00080000:1.0:1789607969.705232:0:14434:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789607969.805753:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.805872:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520186880 00000100:00100000:2.0:1789607969.805899:0:14430:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520186880 00000100:00100000:2.0:1789607969.805965:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:2.0:1789607969.805990:0:14430:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+21:14575:x1876539520186880:12345-192.168.202.3@tcp:101:lfs.0 00010000:00010000:2.0:1789607969.806017:0:14430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789607969.806042:0:14430:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387747 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe073770ece8b9af0 expref: -99 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789607969.806136:0:14430:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789607969.806277:0:14430:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387747 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9af0 expref: 23 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.806292:0:14430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a1c2fa2500) 00010000:00010000:2.0:1789607969.806296:0:14430:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789607969.806301:0:14430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1d103a200/0x33f091d001387747 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.3@tcp remote: 0xe073770ece8b9af0 expref: 23 pid: 14430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789607969.806316:0:14430:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a1d103a200, rc 0) 00000100:00100000:2.0:1789607969.806381:0:14430:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200cec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+22:14575:x1876539520186880:12345-192.168.202.3@tcp:101:lfs.0 Request processed in 407us (640us total) trans 8589934633 rc 301/301 00000100:00100000:2.0:1789607969.806389:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 61 00000100:00100000:2.0:1789607969.812761:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607969.812863:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520187008 00000100:00100000:0.0:1789607969.812874:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520187008 00000100:00100000:0.0:1789607969.812935:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:0.0:1789607969.812946:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+22:14575:x1876539520187008:12345-192.168.202.3@tcp:34:lfs.0 00010000:00010000:0.0:1789607969.813045:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387755 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813063:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387755 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813077:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387755 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813094:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d00138775c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813121:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d00138775c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813129:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d00138775c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813376:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad200/0x33f091d001387763 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813386:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad200/0x33f091d001387763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813393:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad200/0x33f091d001387763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789607969.813462:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad200/0x33f091d001387763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813475:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387755 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813482:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387755 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813489:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387755 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813495:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ad600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607969.813500:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387755 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813507:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387755 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813525:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a1c5961800) 00010000:00010000:0.0:1789607969.813528:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607969.813543:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387755 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813550:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad600/0x33f091d001387755 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813562:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d00138775c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813568:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d00138775c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813573:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d00138775c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813578:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ac600 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607969.813581:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d00138775c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813586:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d00138775c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813594:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99a1f911d000) 00010000:00010000:0.0:1789607969.813596:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607969.813599:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d00138775c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813605:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ac600/0x33f091d00138775c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813633:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad200/0x33f091d001387763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813639:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad200/0x33f091d001387763 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813645:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad200/0x33f091d001387763 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813650:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a1ee2ad200 already unused, calling callback (ffffffffc1f534f0) 00010000:00010000:0.0:1789607969.813653:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad200/0x33f091d001387763 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813658:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad200/0x33f091d001387763 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813666:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a1f911d200) 00010000:00010000:0.0:1789607969.813668:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789607969.813671:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad200/0x33f091d001387763 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789607969.813676:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a1ee2ad200/0x33f091d001387763 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789607969.813757:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8f07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+22:14575:x1876539520187008:12345-192.168.202.3@tcp:34:lfs.0 Request processed in 812us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607969.813765:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 62 00000100:00100000:3.0:1789607969.817858:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:2.0:1789607969.818032:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520187264 00000100:00100000:2.0:1789607969.818044:0:14435:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520187264 00000100:00100000:2.0:1789607969.818113:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 15 00000100:00100000:2.0:1789607969.818125:0:14435:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+22:14575:x1876539520187264:12345-192.168.202.3@tcp:35:lfs.0 00000100:00100000:2.0:1789607969.818416:0:14435:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200cedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+23:14575:x1876539520187264:12345-192.168.202.3@tcp:35:lfs.0 Request processed in 293us (566us total) trans 8589934634 rc 0/0 00000100:00100000:2.0:1789607969.818681:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 15 00010000:00010000:0.0:1789607969.867758:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789607970.444574:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a1e8f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541141376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789607970.444647:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789607970.444864:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541141376 00000100:00100000:2.0:1789607970.444874:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541141376 00000100:00100000:2.0:1789607970.444938:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607970.444956:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a0c2702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541141376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789607970.444999:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789607970.445049:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a0c2702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541141376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607970.445056:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789607970.445100:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a1e8f04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541141376:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789607970.450501:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789607970.891809:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607971.123552:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607971.123592:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607971.123638:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607971.123663:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607971.123682:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607971.123701:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607971.123725:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607971.123753:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520187904 00000100:00100000:0.0:1789607971.123764:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520187904 00000100:00100000:0.0:1789607971.123821:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520187520 00000100:00100000:0.0:1789607971.123825:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520187520 00000100:00100000:0.0:1789607971.123842:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:0.0:1789607971.123851:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6e80d5c-081b-40da-8a54-f28641401897+6:2374:x1876539520187904:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607971.123931:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6e80d5c-081b-40da-8a54-f28641401897+6:2374:x1876539520187904:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 80us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607971.123939:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 30 00000100:00100000:0.0:1789607971.123974:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:0.0:1789607971.123981:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+23:2374:x1876539520187520:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607971.124009:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3e4d0e76-8b10-4097-8a3e-1656392a0727+23:2374:x1876539520187520:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607971.124015:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 31 00000100:00100000:0.0:1789607971.124034:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520187648 00000100:00100000:0.0:1789607971.124038:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520187648 00000100:00100000:0.0:1789607971.124056:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520188160 00000100:00100000:0.0:1789607971.124059:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520188160 00000100:00100000:0.0:1789607971.124073:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520187776 00000100:00100000:0.0:1789607971.124076:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520187776 00000100:00100000:0.0:1789607971.124086:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520188032 00000100:00100000:0.0:1789607971.124088:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520188032 00000100:00100000:0.0:1789607971.124099:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:0.0:1789607971.124114:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2374:x1876539520187648:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607971.124141:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+5:2374:x1876539520187648:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 28us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607971.124146:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 20 00000100:00100000:0.0:1789607971.124158:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:0.0:1789607971.124163:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520188160:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607971.124184:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff419880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520188160:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 21us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607971.124190:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:0.0:1789607971.124201:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:0.0:1789607971.124207:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+8:2374:x1876539520187776:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607971.124229:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+8:2374:x1876539520187776:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 22us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607971.124234:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 22 00000100:00100000:0.0:1789607971.124244:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00100000:0.0:1789607971.124250:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520188032:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:0.0:1789607971.124271:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e6e80d5c-081b-40da-8a54-f28641401897+5:2374:x1876539520188032:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 22us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607971.124278:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 23 00000100:00080000:0.0:1789607971.124299:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789607971.124303:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789607971.124305:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789607971.124899:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520187392 00000100:00100000:3.0:1789607971.124906:0:14424:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520187392 00000100:00100000:3.0:1789607971.125087:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 123 00000100:00100000:3.0:1789607971.125096:0:14424:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:2374:x1876539520187392:12345-192.168.202.3@tcp:400:kworker.0 00000100:00100000:3.0:1789607971.125152:0:14424:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d77ce731-97c5-433c-91e3-ef21b84dcc39+13:2374:x1876539520187392:12345-192.168.202.3@tcp:400:kworker.0 Request processed in 58us (1612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607971.125159:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 123 00000040:00080000:2.0:1789607971.726690:0:14465:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789607971.726704:0:14465:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789607971.726746:0:14465:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789607971.726756:0:14465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:2.0:1789607971.765762:0:16700:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:2.0:1789607971.920468:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789607972.939869:0:14419:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789607973.168940:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:0.0:1789607973.169014:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.3@tcp (source: 12345-192.168.202.3@tcp) 00000100:00100000:1.0:1789607973.169125:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520188288 00000100:00100000:1.0:1789607973.169137:0:15120:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520188288 00002000:00100000:1.0:1789607973.169210:0:15120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff99a1ff41b100 x1876539520188288/t0(0) o4->3e4d0e76-8b10-4097-8a3e-1656392a0727@192.168.202.3@tcp:529/0 lens 504/0 e 0 to 0 dl 1789607984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789607973.169230:0:15120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1ff41b100 with x1876539520188288 ext(0->8) 00002000:00010000:1.0:1789607973.169236:0:15120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1ff41b100 00000100:00100000:1.0:1789607973.169269:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 0 00000100:00100000:1.0:1789607973.169280:0:15120:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+8:2375:x1876539520188288:12345-192.168.202.3@tcp:4:bash.0 00000100:00100000:1.0:1789607973.169833:0:15120:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff41b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3e4d0e76-8b10-4097-8a3e-1656392a0727+10:2375:x1876539520188288:12345-192.168.202.3@tcp:4:bash.0 Request processed in 551us (899us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1789607973.169841:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 0 00002000:00100000:1.0:1789607973.169848:0:15120:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff99a1ff41b100 x1876539520188288/t8589934598(0) o4->3e4d0e76-8b10-4097-8a3e-1656392a0727@192.168.202.3@tcp:529/0 lens 504/448 e 0 to 0 dl 1789607984 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1789607973.169868:0:15120:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a1ff41b100 with x1876539520188288 ext(0->8) 00002000:00010000:1.0:1789607973.169872:0:15120:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a1ff41b100 00000100:00080000:0.0:1789607973.173471:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789607973.173866:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539520188416 00000100:00100000:2.0:1789607973.173876:0:15115:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539520188416 00000100:00100000:2.0:1789607973.173938:0:15115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:2.0:1789607973.173955:0:15115:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1fb842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+10:2375:x1876539520188416:12345-192.168.202.3@tcp:16:kworker.0 00000001:00080000:0.0:1789607973.396104:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000001:00080000:0.0:1789607973.396126:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1789607973.396137:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000100:00100000:2.0:1789607973.396405:0:15115:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1fb842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3e4d0e76-8b10-4097-8a3e-1656392a0727+6:2375:x1876539520188416:12345-192.168.202.3@tcp:16:kworker.0 Request processed in 222445us (227384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789607973.396418:0:15115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.3@tcp, seq: 21 00000100:00100000:3.0:1789607973.519299:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607973.519323:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a200cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541141504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607973.519394:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607973.519493:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541141504 00000100:00100000:3.0:1789607973.519526:0:15119:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541141504 00000100:00100000:3.0:1789607973.519592:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789607973.519602:0:15119:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541141504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789607973.519624:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789607973.519667:0:15119:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200ceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1876539541141504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607973.519674:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789607973.519695:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789607973.519723:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1789607973.519728:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a1f55a8380, transno 8589934595 00000004:00080000:3.0:1789607973.519739:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789607973.519776:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a200cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1876539541141504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789607973.521158:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a200ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541141888:0@lo:400:kworker.0 00000100:00100000:3.0:1789607973.521229:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607973.521261:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789607973.521267:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a200ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541142016:0@lo:400:kworker.0 00000100:00100000:3.0:1789607973.521288:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789607973.521314:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541141888 00000100:00100000:3.0:1789607973.521321:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541141888 00000100:00100000:3.0:1789607973.521357:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541142016 00000100:00100000:3.0:1789607973.521360:0:14433:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541142016 00000100:00100000:3.0:1789607973.521386:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789607973.521394:0:14433:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541141888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607973.521614:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a200cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3309:1876539541141632:0@lo:400:kworker.0 00000100:00100000:0.0:1789607973.521650:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607973.521681:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a200ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541142144:0@lo:400:kworker.0 00000100:00100000:0.0:1789607973.521702:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607973.521715:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789607973.521721:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff99a200cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541141760:0@lo:400:kworker.0 00000100:00100000:0.0:1789607973.521742:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789607973.521785:0:14430:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789607973.521793:0:14430:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789607973.521806:0:14432:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789607973.521811:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541142144 00000100:00100000:0.0:1789607973.521814:0:14432:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541142144 00000100:00100000:0.0:1789607973.521833:0:14432:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789607973.521856:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789607973.521863:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a200cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541142016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607973.530187:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200cef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1876539541142016:12345-0@lo:400:kworker.0 Request processed in 8313us (8887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607973.530205:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789607973.530244:0:14432:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789607973.530258:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789607973.530270:0:14432:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541142144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607973.530345:0:14432:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876539541142144:12345-0@lo:400:kworker.0 Request processed in 80us (8642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607973.530351:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789607973.530391:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541141632 00000100:00100000:0.0:1789607973.530401:0:14425:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541141632 00000100:00100000:0.0:1789607973.530454:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789607973.530461:0:14425:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1e8c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:3309:x1876539541141632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607973.530494:0:14425:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1e8c00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4d421aa7-30b1-4c66-8975-0b6c2f7ce121+19:3309:x1876539541141632:12345-0@lo:400:kworker.0 Request processed in 34us (8843us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607973.530515:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789607973.530549:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876539541141760 00000100:00100000:0.0:1789607973.530553:0:15117:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876539541141760 00000100:00100000:0.0:1789607973.530585:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789607973.530592:0:15117:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff99a1ff418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541141760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789607973.530625:0:15117:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a1ff418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876539541141760:12345-0@lo:400:kworker.0 Request processed in 34us (8882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789607973.530631:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789607973.530730:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a200cefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1876539541141760:0@lo:400:kworker.0 00000100:00100000:0.0:1789607973.530740:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a200cef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4d421aa7-30b1-4c66-8975-0b6c2f7ce121:3309:1876539541141632:0@lo:400:kworker.0 00000100:00100000:0.0:1789607973.530764:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a200ced180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1876539541142144:0@lo:400:kworker.0 00000100:00080000:2.0:1789607973.533487:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789607973.533508:0:14427:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789607973.533665:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a200ced500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1876539541142016:0@lo:400:kworker.0 00000100:00100000:3.0:1789607973.534127:0:14433:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff99a200cec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1876539541141888:12345-0@lo:400:kworker.0 Request processed in 12730us (12895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789607973.534140:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789607973.534249:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff99a200ceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1876539541141888:0@lo:400:kworker.0 00010000:00010000:2.0:1789607973.971369:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29981 lines, 29981 kept, 0 dropped, 0 bad.